-- Logs begin at Thu 2022-03-31 17:11:33 UTC, end at Thu 2022-03-31 18:45:30 UTC. -- Mar 31 18:04:32.753424 dv-cinder-master-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Mar 31 18:04:32.765038 dv-cinder-master-3-iscsi devstack@n-api.service[103152]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Mar 31 18:04:32.767101 dv-cinder-master-3-iscsi devstack@n-api.service[103152]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Mar 31 18:04:32 2022] *** Mar 31 18:04:32.767101 dv-cinder-master-3-iscsi devstack@n-api.service[103152]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Mar 31 18:04:32.767101 dv-cinder-master-3-iscsi devstack@n-api.service[103152]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Mar 31 18:04:32.767101 dv-cinder-master-3-iscsi devstack@n-api.service[103152]: nodename: dv-cinder-master-3-iscsi Mar 31 18:04:32.767101 dv-cinder-master-3-iscsi devstack@n-api.service[103152]: machine: x86_64 Mar 31 18:04:32.767101 dv-cinder-master-3-iscsi devstack@n-api.service[103152]: clock source: unix Mar 31 18:04:32.767101 dv-cinder-master-3-iscsi devstack@n-api.service[103152]: pcre jit disabled Mar 31 18:04:32.767101 dv-cinder-master-3-iscsi devstack@n-api.service[103152]: detected number of CPU cores: 4 Mar 31 18:04:32.767101 dv-cinder-master-3-iscsi devstack@n-api.service[103152]: current working directory: / Mar 31 18:04:32.767101 dv-cinder-master-3-iscsi devstack@n-api.service[103152]: detected binary path: /usr/bin/uwsgi-core Mar 31 18:04:32.767740 dv-cinder-master-3-iscsi devstack@n-api.service[103152]: your processes number limit is 47680 Mar 31 18:04:32.767740 dv-cinder-master-3-iscsi devstack@n-api.service[103152]: your memory page size is 4096 bytes Mar 31 18:04:32.767740 dv-cinder-master-3-iscsi devstack@n-api.service[103152]: detected max file descriptor number: 2048 Mar 31 18:04:32.767740 dv-cinder-master-3-iscsi devstack@n-api.service[103152]: lock engine: pthread robust mutexes Mar 31 18:04:32.767740 dv-cinder-master-3-iscsi devstack@n-api.service[103152]: thunder lock: enabled Mar 31 18:04:32.767740 dv-cinder-master-3-iscsi devstack@n-api.service[103152]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Mar 31 18:04:32.767740 dv-cinder-master-3-iscsi devstack@n-api.service[103152]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Mar 31 18:04:32.812936 dv-cinder-master-3-iscsi devstack@n-api.service[103152]: Python main interpreter initialized at 0x55a155bcd9c0 Mar 31 18:04:32.812936 dv-cinder-master-3-iscsi devstack@n-api.service[103152]: python threads support enabled Mar 31 18:04:32.812936 dv-cinder-master-3-iscsi devstack@n-api.service[103152]: your server socket listen backlog is limited to 100 connections Mar 31 18:04:32.812936 dv-cinder-master-3-iscsi devstack@n-api.service[103152]: your mercy for graceful operations on workers is 90 seconds Mar 31 18:04:32.813309 dv-cinder-master-3-iscsi devstack@n-api.service[103152]: mapped 403077 bytes (393 KB) for 2 cores Mar 31 18:04:32.813385 dv-cinder-master-3-iscsi devstack@n-api.service[103152]: *** Operational MODE: preforking *** Mar 31 18:04:32.813588 dv-cinder-master-3-iscsi devstack@n-api.service[103152]: *** uWSGI is running in multiple interpreter mode *** Mar 31 18:04:32.813588 dv-cinder-master-3-iscsi devstack@n-api.service[103152]: spawned uWSGI master process (pid: 103152) Mar 31 18:04:32.813790 dv-cinder-master-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Mar 31 18:04:32.814909 dv-cinder-master-3-iscsi devstack@n-api.service[103152]: spawned uWSGI worker 1 (pid: 103153, cores: 1) Mar 31 18:04:32.815138 dv-cinder-master-3-iscsi devstack@n-api.service[103152]: spawned uWSGI worker 2 (pid: 103154, cores: 1) Mar 31 18:04:32.815306 dv-cinder-master-3-iscsi devstack@n-api.service[103152]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Mar 31 18:04:34.003434 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Mar 31 18:04:34.005315 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Mar 31 18:04:34.857909 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 31 18:04:34.857909 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: from cryptography.utils import int_from_bytes Mar 31 18:04:34.858236 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 31 18:04:34.858236 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: from cryptography.utils import int_from_bytes Mar 31 18:04:34.859179 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 31 18:04:34.859179 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: from cryptography.utils import int_from_bytes Mar 31 18:04:34.859503 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 31 18:04:34.859503 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: from cryptography.utils import int_from_bytes Mar 31 18:04:37.442891 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 31 18:04:37.443423 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 31 18:04:37.443579 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 31 18:04:37.443945 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 31 18:04:37.444052 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 31 18:04:37.444400 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 31 18:04:37.444491 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 31 18:04:37.444585 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.444754 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 31 18:04:37.444880 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.445122 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 31 18:04:37.445208 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.445385 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 31 18:04:37.445512 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.445776 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.445869 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.446106 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.446190 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.446441 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.446527 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.446788 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.446887 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.447118 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.447216 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.447381 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.447473 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.447700 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.447790 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.448024 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-iscsi {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.448117 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.448346 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.448438 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.448650 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.448740 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.448959 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.449050 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.449275 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.449359 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-iscsi {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.449580 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.449663 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.449899 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.449983 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.450202 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.450284 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.450523 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.450720 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.450859 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.451177 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.451311 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.451486 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.451588 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.451799 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.452011 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.452727 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.453053 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.453154 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.453373 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.453466 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.453691 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.453775 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.454003 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.454163 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.454329 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.454425 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.454664 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.454760 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.454998 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.455124 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-iscsi {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.455317 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.455420 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.455648 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.455777 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.455967 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.456055 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.456367 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-iscsi {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.456522 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.456685 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.456776 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.456996 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.457100 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.457316 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.457404 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.457633 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.457758 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.457940 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.458077 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.458264 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.458392 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.458583 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.458742 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.458926 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.459056 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.459245 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.459369 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.459546 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.459700 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.459854 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.460026 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.460159 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.460347 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.460475 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.460670 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.460777 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.460976 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.461082 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.461286 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.461377 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.461600 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.461693 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.461923 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.462016 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.462232 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.462318 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.462540 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.462718 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.462807 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.462940 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.463120 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.463207 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.463437 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.463523 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.463757 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.463842 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.464070 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.464168 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.464340 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.464437 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.464595 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.464690 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.464918 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.465018 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.465242 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.465328 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.465547 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.465643 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.465853 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.465947 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.466160 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.466247 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.466468 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.466561 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.466803 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.466914 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.467120 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.467215 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.467427 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.467511 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.468348 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.468456 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.468718 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.468814 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.469005 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.469098 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.469315 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.469409 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.469653 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.469739 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.469972 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.470063 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.470280 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.470426 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.470597 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.470739 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.470941 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.471026 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.471250 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.471337 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.471556 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.471642 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.471862 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.471946 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.472179 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.472265 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.472500 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.472586 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.472804 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.472945 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.473054 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.473175 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.473355 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.473463 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.473662 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.473789 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.473978 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.474217 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.474318 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.474424 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.474582 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.474744 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.474912 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.474998 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.475214 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.475301 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.475520 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.475614 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.475826 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.475911 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.476132 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.476223 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.476443 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.476537 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.476750 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.476835 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.477055 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.477139 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.477360 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.477446 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.477664 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.477749 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.477966 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.478051 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.478276 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.478361 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.478584 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.478700 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.478913 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.479008 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.479221 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.479311 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.479523 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.479615 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.479831 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.479924 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.480150 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.480235 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.480452 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.480536 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.480758 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.480842 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.481067 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.481154 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.481373 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.481466 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.481679 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.481771 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.481989 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.482074 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.482295 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.482380 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.482623 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.482711 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.482938 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.483024 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.483239 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.483356 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.483574 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.483757 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.483948 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.484179 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.484283 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.484484 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.484588 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.484785 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.484873 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.485090 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.485176 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.485396 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.485481 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.485700 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.485787 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.486003 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.486094 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.486313 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.486421 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.486619 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.486735 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.486951 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.487050 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.487262 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.487353 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.487569 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.487661 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.487877 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.487960 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.488182 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.488279 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.488484 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.488566 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.488807 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.488899 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.489132 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.489232 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.489448 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.489532 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.489760 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.489844 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.490072 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.490188 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.490396 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:04:37.490481 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.490740 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.490829 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.491058 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.491144 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.491375 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.491460 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.491702 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.491793 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.492016 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.492109 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.492332 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.492424 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.492643 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.492729 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.492962 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.493069 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.493287 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.493436 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.493616 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.493701 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.493932 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.494017 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.494247 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.494349 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.494561 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.494694 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.494913 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.495002 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.495232 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.495315 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.495562 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.495647 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.495883 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.495975 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.496199 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.496284 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.496520 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.496606 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.496843 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.496929 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.497168 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.497261 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.497492 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.497592 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.497817 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.497904 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.498130 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.498222 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.498442 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.498540 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.498790 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.498878 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.499156 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.499292 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.499490 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.499714 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.499802 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.500049 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.500136 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.500374 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.500460 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.500697 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.500784 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.501016 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.501108 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.501332 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.501425 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.501645 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.501731 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.501982 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.502068 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.502300 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.502445 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.502645 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.502735 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.502957 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.503043 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.503278 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.503384 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.503587 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.503673 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.503901 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.503987 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.504216 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.504389 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.504526 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.504611 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.504832 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.504920 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.505139 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.505226 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.505452 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.505537 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.505760 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.505852 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.506088 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.506175 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.506406 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.506490 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.506736 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.506835 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.507049 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.507136 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.507362 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.507447 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.507673 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.507757 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.507982 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.508067 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.508290 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.508374 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.508598 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.508691 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.508912 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.508998 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.509225 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.509584 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.509799 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.509898 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.510117 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.510207 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.510426 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.510509 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.510759 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.510859 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.511073 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.511164 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.511379 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.511462 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.511684 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.511778 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.511996 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.512086 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.512307 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.512398 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.512619 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.512705 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.512930 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.513023 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.513240 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.513379 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.513560 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.513645 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.513871 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.513962 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.514187 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.514273 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.514500 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.515106 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.515384 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.515520 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.515695 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.515944 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.516102 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.516272 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.516405 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.516608 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.516738 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.516932 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.517067 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.517242 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.517380 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.517551 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.517686 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.517859 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.518003 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.518165 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.518305 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.518474 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.518636 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.518806 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.518937 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.519115 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.519251 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.519421 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.519550 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.519727 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.519864 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.520033 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.520169 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.520355 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.520491 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.520664 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.520803 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.520971 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.521110 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.521279 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.521415 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.521587 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.521723 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.521919 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.522064 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.522228 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.522365 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.522538 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.522707 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.522892 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.523029 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.523222 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.523362 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.523532 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.523625 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.523845 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.523934 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.524158 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.524245 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.524470 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.524553 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.524786 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.524872 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.525101 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.525188 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.525418 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.525512 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.525743 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.525828 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.526058 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.526153 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.526386 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.526472 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.526725 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.526825 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.527055 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.527143 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.527371 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.527457 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.527691 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.527775 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.527998 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.528083 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.528316 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.528401 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.528633 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.528726 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.528977 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.529062 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.529295 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.529386 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.529617 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.529714 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.529929 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.530014 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.530362 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.530994 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.531225 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.531325 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.531542 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.531628 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.531857 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.531983 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.532173 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.532328 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.532496 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.532657 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.532808 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.532990 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.533128 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.533315 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.533439 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.533640 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.533762 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.533961 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.534061 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.534282 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.534375 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.534627 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.534727 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.534945 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.535111 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.535274 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.535413 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.535594 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.535679 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.535921 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.536015 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.536234 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.536318 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.536563 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.536647 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.536875 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.536969 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.537186 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.537272 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.537497 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.537590 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.537803 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.537895 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.538110 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.538197 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.538419 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.538504 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.538764 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.538855 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.539079 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.539166 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.539389 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.539475 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.539696 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.539790 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.540009 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.540096 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.540319 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.540405 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.540624 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.540711 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.540928 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.541013 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.541240 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.541334 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.541559 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.541651 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.541871 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.541956 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.542186 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.542285 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.542496 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.542583 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.542823 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.542920 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.543128 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.543222 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.543434 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.543519 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.543739 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.543834 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.544042 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.544138 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.544347 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.544433 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.544652 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.544744 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.544977 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.545062 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.545292 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.545377 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.545598 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.545700 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.545956 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.546094 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.546341 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.546448 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.546669 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.546759 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.546987 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.547081 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.547297 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.547382 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.547606 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.547692 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.547927 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.548013 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.548244 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.548329 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.548552 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.548650 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.548861 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.548955 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.549170 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.549258 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.549480 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.549573 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.549791 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.549914 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.550104 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.550196 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.550410 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.550503 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.550777 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.550880 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.551058 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.551147 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.551364 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.551460 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.551675 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.551762 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.551987 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.552080 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.552305 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.552562 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.552655 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.552899 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.552984 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.553220 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.553313 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.553534 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.553618 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.553851 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.553946 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.554161 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.554258 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.554477 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.554562 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.554820 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.554918 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.555163 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.555394 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.555493 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.555737 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.555835 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.556059 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.556146 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.556370 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.556465 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.556684 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.556777 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.556992 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.557079 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.557300 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.557387 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.557606 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.557699 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.557916 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.558002 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.558221 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.558320 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.558525 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.558631 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.558855 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.558985 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.559161 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.559324 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.559476 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.559642 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.559782 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.559955 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.560094 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.560267 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.560397 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.560577 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.560718 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.560891 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.561027 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.561200 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.561332 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.561537 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.561668 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.561846 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.561974 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.562155 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.562303 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.562474 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.562641 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.562830 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.562963 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.563148 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.563292 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.563459 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.563632 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.563785 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.563932 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.564098 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.564230 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.564408 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.564551 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.564719 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.564855 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.565045 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.565157 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.565393 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.565479 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.565780 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.566152 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.566238 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.566317 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.566317 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.566460 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.566656 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.566759 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.566968 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.567054 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.567278 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.567363 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.567586 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.567673 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.567890 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.567976 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.568197 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.568284 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.568499 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.568586 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.568808 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.568892 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.569112 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.569202 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.569415 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.569510 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.569718 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.569803 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.570028 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.570121 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.570332 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.570423 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.570651 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.570750 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.570961 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.571054 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.571261 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.571346 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.571567 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.571651 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.571867 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.571963 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.572170 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.572256 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.572474 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.572559 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.572779 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.572872 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.573085 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.573171 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.573387 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.573473 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.573706 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.573800 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.574018 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.574103 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.574322 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.574408 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.574647 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.574737 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.574962 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.575047 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.575266 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.575351 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.575568 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.575654 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.575877 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.575972 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.576183 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.576273 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.576496 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.576590 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.576799 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.576883 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.577640 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.577745 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.577947 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.578039 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.578251 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.578335 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.578556 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.578668 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.578886 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.578972 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.579190 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.579273 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.579493 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.579589 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.579796 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.579882 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.580099 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.580184 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.580401 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.580495 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.580711 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.580801 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.581018 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.581109 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.581323 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.581410 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.581627 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.581710 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.581928 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.582011 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.582229 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.582314 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.582535 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.582655 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.582865 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.582960 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.583172 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.583259 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.583504 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.583590 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.583827 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.583931 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.584139 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.584231 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.584446 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.584531 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.584757 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.584851 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.585061 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.585144 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.585379 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.585467 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.585691 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.585785 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.586006 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.586106 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.586309 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.586405 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.586631 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.586733 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.586962 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.587050 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.587275 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.587361 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.587586 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.587684 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.587907 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.587993 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.588214 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.588297 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.588537 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.588624 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.588840 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.588970 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.589150 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.589242 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.589455 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.589541 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.589763 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.589846 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.590070 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.590156 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.590379 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.590478 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.590728 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.590827 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.591042 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.591127 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.591352 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.591439 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.591664 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.591751 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.591976 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.592062 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.592278 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.592369 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.592587 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.592689 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.593455 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.593841 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.593841 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.594026 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.594108 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.594239 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.594365 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.594464 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.594695 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.594793 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.595006 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.595095 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.595312 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.595408 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.595623 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.595719 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.595927 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.596070 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.596237 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.596377 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.596550 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.596657 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.596863 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.596976 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.597189 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.597277 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.597503 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.597589 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.597810 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.597897 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.598124 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.598211 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.598433 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.598520 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.598773 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.598863 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.599188 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.599313 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.599516 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.599628 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.599832 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.599952 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.600146 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.600233 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.600454 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.600541 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.600759 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.600852 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.601071 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.601163 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.601396 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.601489 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.601704 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.601799 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.602010 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.602097 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.602315 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.602443 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.602655 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.602791 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.602964 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.603111 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.603285 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.603430 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.603702 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.603804 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.604016 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.604103 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.604322 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.604409 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.604653 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.604740 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.604964 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.605050 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.605273 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.605358 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.605582 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.605670 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.605908 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.605994 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.606218 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.606312 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.606541 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.606650 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.606903 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.606988 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.607217 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.607314 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.607543 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.607629 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.607869 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.608013 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.608183 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.608721 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.609069 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.609278 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.609362 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.609444 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.609523 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.609610 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.609691 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.609923 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.610012 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.610092 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.610178 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.610259 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.610446 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.610543 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.610796 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.610903 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.611111 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.611198 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.611434 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.611529 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.611760 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.611855 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.612070 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.612157 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.612377 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.612479 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.612687 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.612774 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.612993 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.613085 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.613302 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.613390 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.613622 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.613758 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.613928 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.614088 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.614240 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.614406 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.614551 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.614760 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.614902 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.615088 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.615194 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.615402 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.615491 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.615726 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.615826 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.616044 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.616164 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.616357 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.616464 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.616668 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.616774 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.616997 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.617086 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.617307 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.617392 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.617612 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.617698 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.617924 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.618010 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.618232 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.618317 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.618537 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.618652 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.618865 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.618959 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.619171 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.619257 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.619485 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.619591 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.619805 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.619902 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.620121 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.620205 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.620446 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.620543 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.620766 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.620857 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.621075 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.621161 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.621402 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.621497 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.621716 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.621813 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.622026 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.622112 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.622334 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.622430 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.622663 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.622764 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.622974 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.623060 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.623278 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.623365 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.623587 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.623681 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.623891 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.624024 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.624220 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.624311 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.624599 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.624684 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.624940 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.625051 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.625252 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.625346 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.625558 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.625655 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.625860 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.625947 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.626181 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.626269 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.626488 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.626587 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.626827 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.626933 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.627162 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.627264 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.627444 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.627529 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.627748 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.627850 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.628053 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.628138 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.628363 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.628450 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.628669 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.628770 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.628974 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.629060 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.629280 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.629373 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.629606 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.629713 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.629912 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.630000 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.630224 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.630313 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.630536 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.630666 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.630872 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.630984 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.631187 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.631306 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.631498 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.631600 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.631813 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.631922 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.632138 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.632233 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.632455 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.632549 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.632775 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.632870 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.633087 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.633229 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.633435 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.633581 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.633716 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.633857 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.634000 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.634136 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.634642 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.634814 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.634971 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.635146 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.635290 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.635463 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.635606 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.635778 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.635913 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.636092 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.636247 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.636404 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.636569 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.636709 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.636895 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.637033 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.637215 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.637346 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.637535 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.637656 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.637857 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.637968 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.638296 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.638384 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.638629 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.638784 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.638967 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.639108 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.639304 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.639427 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.640160 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.640297 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.640611 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.640699 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.640934 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.641021 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.641254 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.641349 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.641573 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.641670 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.641889 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.641976 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.642206 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.642293 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.642520 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.642638 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.642868 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.642964 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.643186 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.643273 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.643502 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.643590 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.643816 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.643902 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.644134 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.644226 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.644452 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.644540 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.644761 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.644856 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.645072 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.645166 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.645387 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.645481 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.645701 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.645787 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.646022 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.646116 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.646357 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.646451 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.646710 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.646804 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.647026 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.647136 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.647339 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.647426 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.647655 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.647743 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.647974 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.648176 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.648290 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.648492 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.648607 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.648827 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.648925 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.649153 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.649239 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.649479 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.649565 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.649798 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.649896 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.650122 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.650229 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.650440 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.650532 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.650771 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.650873 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.651079 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.651171 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.651392 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.651657 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.651753 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.651983 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.652075 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.652304 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.652389 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.652615 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.652713 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.652922 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.653009 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.653242 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.653329 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.653550 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.653646 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.653891 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.654085 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.654204 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.654431 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.654526 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.654771 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.654870 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.655099 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.655205 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.655541 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.655653 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.655817 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.655903 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.656126 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.656219 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.656449 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.656542 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.656758 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.656843 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.657070 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.657188 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.657383 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.657625 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.657735 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.657973 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.658078 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.658281 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.658500 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.658592 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.658687 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.658916 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.659011 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.659269 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.659491 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.659590 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.659815 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.659901 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.660126 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.660223 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.660460 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.660559 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.660768 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.660855 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.661077 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.661163 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.661383 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.661476 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.661697 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.661789 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.662004 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.662097 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.662312 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.662400 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.662632 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.662720 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.662953 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.663053 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.663260 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.663346 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.663564 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.663648 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.663876 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.664043 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.664184 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.664269 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.664540 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.664643 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.664825 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.664920 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.665137 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.665224 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.665449 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.665605 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.665747 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.665898 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.666036 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.666178 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.666354 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.666485 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.666684 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.666776 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.667000 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.667095 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.667318 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.667426 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.667632 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.667721 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.667942 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.668028 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.668256 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.668350 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.668592 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.668686 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.668920 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.669138 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.669225 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.669476 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.669571 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.669801 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.669887 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.670127 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.670212 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.670454 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.670589 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.670789 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.671421 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.671632 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.671735 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.671940 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.672084 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.672267 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.672409 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.672583 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.672898 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.672996 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.673210 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.673298 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.673520 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.673606 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.673832 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.673932 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.674143 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.674234 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.674454 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.674546 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.674791 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.674881 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.675103 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.675189 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.675414 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.675500 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.675725 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.675822 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.676037 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.676123 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.676354 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.676441 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.676694 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.676782 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.677006 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.677090 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.677332 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.677470 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.677643 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.677731 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.677962 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.678051 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.678277 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.678371 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.678586 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.678702 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.678920 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.679007 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.679233 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.679336 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.679552 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.679639 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.679882 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.679970 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.680197 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.680284 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.680504 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.680640 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.680881 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.680965 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.681228 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.681317 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.681547 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.681632 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.681871 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.681957 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.682184 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.682278 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.682508 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.682594 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.682867 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.682955 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.683181 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.683270 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.683504 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.683590 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.683827 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.683939 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.684146 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.684244 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.684485 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.684572 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.684816 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.684910 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.685142 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.685229 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.685448 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.685536 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.685756 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.685852 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.686064 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.686151 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.686375 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.686489 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.687352 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.687558 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.687713 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.687997 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.688083 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.688321 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.688418 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.688634 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.688721 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.688942 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.689028 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.689249 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.689343 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.689556 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.689643 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.689862 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.689948 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.690171 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.690259 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.690474 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.690564 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.690808 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.690905 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.691116 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.691204 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.691422 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.691509 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.691729 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.691822 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.692034 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.692122 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.692344 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.692438 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.692651 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.692738 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.693002 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.693103 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.693263 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.693349 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.693568 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.693668 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.693873 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.693960 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.694181 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.694269 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.694492 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.694777 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.694870 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.694950 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.695122 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.695214 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.695430 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.695527 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.695745 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.695882 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.696054 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.696141 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.696364 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.696463 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.696674 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.696760 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.696984 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.697069 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.697295 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.697382 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.697624 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.697709 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.697939 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.698025 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.698253 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.698340 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.698567 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.698673 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.698916 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.699002 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.699228 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.699317 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.699539 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.699632 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.699863 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.699957 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.700185 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.700271 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.700494 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.700580 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.700805 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.700897 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.701125 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.701212 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.701445 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.701531 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.701762 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.701855 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.702110 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.702236 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.702525 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.702645 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.702870 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.703014 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.703186 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.703336 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.703503 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.703673 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.703819 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.704006 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.704136 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.704318 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.704456 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.704650 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.704774 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.704975 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.705102 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.705301 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.705430 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.705623 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.705756 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.705944 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.706086 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.706281 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.706435 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.706602 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.706779 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.706939 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.707125 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.707261 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.707461 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.707584 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.707778 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.707902 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.708094 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.708227 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.708402 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.708550 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.708650 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103153) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 31 18:04:37.708881 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.709212 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.709541 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.709870 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.710224 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.710547 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.710922 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.711256 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.711579 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.711898 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.712209 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:04:37.712458 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103154) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 31 18:04:37.731848 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG oslo_db.sqlalchemy.engines [None req-038c3312-b0b9-4945-a28e-12c13ecc54b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103153) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 31 18:04:37.735809 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG oslo_db.sqlalchemy.engines [None req-1856c585-39f0-4652-a8e7-5d7addae5e39 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103154) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 31 18:04:37.796631 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.context [None req-038c3312-b0b9-4945-a28e-12c13ecc54b8 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1ceefcae-4d4b-47f0-bf59-76eb32505fbe(cell1) {{(pid=103153) load_cells /opt/stack/nova/nova/context.py:464}} Mar 31 18:04:37.800787 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG oslo_concurrency.lockutils [None req-038c3312-b0b9-4945-a28e-12c13ecc54b8 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:04:37.801225 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.context [None req-1856c585-39f0-4652-a8e7-5d7addae5e39 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1ceefcae-4d4b-47f0-bf59-76eb32505fbe(cell1) {{(pid=103154) load_cells /opt/stack/nova/nova/context.py:464}} Mar 31 18:04:37.802351 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG oslo_concurrency.lockutils [None req-038c3312-b0b9-4945-a28e-12c13ecc54b8 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:04:37.803169 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG oslo_concurrency.lockutils [None req-038c3312-b0b9-4945-a28e-12c13ecc54b8 None None] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:04:37.805118 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG oslo_concurrency.lockutils [None req-038c3312-b0b9-4945-a28e-12c13ecc54b8 None None] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103153) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:04:37.805407 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG oslo_concurrency.lockutils [None req-1856c585-39f0-4652-a8e7-5d7addae5e39 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:04:37.807042 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG oslo_concurrency.lockutils [None req-1856c585-39f0-4652-a8e7-5d7addae5e39 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:04:37.807847 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG oslo_concurrency.lockutils [None req-1856c585-39f0-4652-a8e7-5d7addae5e39 None None] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:04:37.809816 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG oslo_concurrency.lockutils [None req-1856c585-39f0-4652-a8e7-5d7addae5e39 None None] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:04:37.815562 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG oslo_db.sqlalchemy.engines [None req-038c3312-b0b9-4945-a28e-12c13ecc54b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103153) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 31 18:04:37.816991 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG oslo_db.sqlalchemy.engines [None req-038c3312-b0b9-4945-a28e-12c13ecc54b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103153) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 31 18:04:37.822518 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG oslo_db.sqlalchemy.engines [None req-1856c585-39f0-4652-a8e7-5d7addae5e39 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103154) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 31 18:04:37.825030 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG oslo_db.sqlalchemy.engines [None req-1856c585-39f0-4652-a8e7-5d7addae5e39 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103154) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 31 18:04:37.980212 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG oslo_db.sqlalchemy.engines [None req-038c3312-b0b9-4945-a28e-12c13ecc54b8 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103153) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 31 18:04:37.989879 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG oslo_db.sqlalchemy.engines [None req-1856c585-39f0-4652-a8e7-5d7addae5e39 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103154) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 31 18:04:38.532460 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: WARNING keystonemiddleware.auth_token [None req-038c3312-b0b9-4945-a28e-12c13ecc54b8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 31 18:04:38.539178 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: WARNING keystonemiddleware.auth_token [None req-038c3312-b0b9-4945-a28e-12c13ecc54b8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 31 18:04:38.562344 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: WARNING keystonemiddleware.auth_token [None req-1856c585-39f0-4652-a8e7-5d7addae5e39 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 31 18:04:38.569063 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: WARNING keystonemiddleware.auth_token [None req-1856c585-39f0-4652-a8e7-5d7addae5e39 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 31 18:04:38.758501 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: WARNING keystonemiddleware.auth_token [None req-038c3312-b0b9-4945-a28e-12c13ecc54b8 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 31 18:04:38.764056 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: WARNING keystonemiddleware.auth_token [None req-038c3312-b0b9-4945-a28e-12c13ecc54b8 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 31 18:04:38.769243 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a155bcd9c0 pid: 103153 (default app) Mar 31 18:04:38.771334 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-038c3312-b0b9-4945-a28e-12c13ecc54b8 None None] Calling method '>' {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:04:38.772486 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-038c3312-b0b9-4945-a28e-12c13ecc54b8 None None] 10.222.0.58 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001727 Mar 31 18:04:38.772895 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 1/1] 10.222.0.58 () {50 vars in 788 bytes} [Thu Mar 31 18:04:38 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:04:38.794602 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: WARNING keystonemiddleware.auth_token [None req-1856c585-39f0-4652-a8e7-5d7addae5e39 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 31 18:04:38.800424 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: WARNING keystonemiddleware.auth_token [None req-1856c585-39f0-4652-a8e7-5d7addae5e39 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 31 18:04:38.805768 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55a155bcd9c0 pid: 103154 (default app) Mar 31 18:06:03.679534 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-038c3312-b0b9-4945-a28e-12c13ecc54b8 None None] Calling method '>' {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:06:03.680540 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-038c3312-b0b9-4945-a28e-12c13ecc54b8 None None] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Mar 31 18:06:03.680943 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 2/2] 10.222.0.58 () {54 vars in 930 bytes} [Thu Mar 31 18:06:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:06:04.116585 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-93e49ba6-2ca7-4916-802a-e9bb1204d04b admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:06:04.148693 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-93e49ba6-2ca7-4916-802a-e9bb1204d04b admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.461040 Mar 31 18:06:04.149354 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 1/3] 10.222.0.58 () {60 vars in 1291 bytes} [Thu Mar 31 18:06:03 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:06:06.627942 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-038c3312-b0b9-4945-a28e-12c13ecc54b8 None None] Calling method '>' {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:06:06.630010 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-038c3312-b0b9-4945-a28e-12c13ecc54b8 None None] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002824 Mar 31 18:06:06.632013 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 3/4] 10.222.0.58 () {54 vars in 930 bytes} [Thu Mar 31 18:06:06 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:06:06.699188 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-e9211137-2d73-40a7-9764-9e840e614cf8 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "disk": 1, "swap": 0, "ram": 256, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "id": "c1", "vcpus": 1}} {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:06:06.717932 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 31 18:06:06.717932 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: warnings.warn(msg) Mar 31 18:06:06.812427 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-e9211137-2d73-40a7-9764-9e840e614cf8 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.174704 Mar 31 18:06:06.812940 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 2/5] 10.222.0.58 () {64 vars in 1282 bytes} [Thu Mar 31 18:06:06 2022] POST /compute/v2.1/flavors => generated 407 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 31 18:06:07.030421 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-110209b6-0a03-4924-a970-6205b1735506 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:06:07.032974 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 31 18:06:07.032974 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: warnings.warn(msg) Mar 31 18:06:07.187663 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-110209b6-0a03-4924-a970-6205b1735506 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.366366 Mar 31 18:06:07.195100 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 4/6] 10.222.0.58 () {64 vars in 1335 bytes} [Thu Mar 31 18:06:06 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:06:09.585223 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-e9211137-2d73-40a7-9764-9e840e614cf8 admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:06:09.586260 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-e9211137-2d73-40a7-9764-9e840e614cf8 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001492 Mar 31 18:06:09.586711 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 3/7] 10.222.0.58 () {54 vars in 930 bytes} [Thu Mar 31 18:06:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:06:09.696186 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-86cbf641-0841-444d-86d2-cb8e988111b3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "rxtx_factor": 1.0, "name": "ds512M", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 1, "id": "d1", "swap": 0, "ram": 512}} {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:06:09.718580 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 31 18:06:09.718580 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: warnings.warn(msg) Mar 31 18:06:09.818908 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-86cbf641-0841-444d-86d2-cb8e988111b3 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.226030 Mar 31 18:06:09.819908 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 5/8] 10.222.0.58 () {64 vars in 1282 bytes} [Thu Mar 31 18:06:09 2022] POST /compute/v2.1/flavors => generated 404 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 31 18:06:09.833836 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-190aa7bd-ef29-4579-a6b7-d9de1905bfec admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:06:09.835351 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 31 18:06:09.835351 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: warnings.warn(msg) Mar 31 18:06:09.932040 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-190aa7bd-ef29-4579-a6b7-d9de1905bfec admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.104234 Mar 31 18:06:09.932986 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 4/9] 10.222.0.58 () {64 vars in 1335 bytes} [Thu Mar 31 18:06:09 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:06:12.404006 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-86cbf641-0841-444d-86d2-cb8e988111b3 admin admin] Calling method '>' {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:06:12.405022 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-86cbf641-0841-444d-86d2-cb8e988111b3 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001484 Mar 31 18:06:12.405429 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 6/10] 10.222.0.58 () {54 vars in 930 bytes} [Thu Mar 31 18:06:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:06:12.474386 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-23860abd-4777-4d7d-934c-7f7c8617678c admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 1024, "name": "ds1G", "id": "d2", "os-flavor-access:is_public": true, "disk": 10, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0}} {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:06:12.560549 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-23860abd-4777-4d7d-934c-7f7c8617678c admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.147674 Mar 31 18:06:12.561323 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 5/11] 10.222.0.58 () {64 vars in 1282 bytes} [Thu Mar 31 18:06:12 2022] POST /compute/v2.1/flavors => generated 404 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 31 18:06:12.573286 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-5c84d0cc-3783-4d1d-a781-73ef33d7f5f8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:06:12.700833 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-5c84d0cc-3783-4d1d-a781-73ef33d7f5f8 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.131582 Mar 31 18:06:12.701833 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 7/12] 10.222.0.58 () {64 vars in 1335 bytes} [Thu Mar 31 18:06:12 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:06:15.130239 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-23860abd-4777-4d7d-934c-7f7c8617678c admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:06:15.131485 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-23860abd-4777-4d7d-934c-7f7c8617678c admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001596 Mar 31 18:06:15.132217 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 6/13] 10.222.0.58 () {54 vars in 930 bytes} [Thu Mar 31 18:06:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 31 18:06:15.204259 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-9e63a9e8-8b54-4a94-8f62-a5ce1962eea5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds2G", "swap": 0, "ram": 2048, "vcpus": 2, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "id": "d3"}} {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:06:15.299680 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-9e63a9e8-8b54-4a94-8f62-a5ce1962eea5 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.161415 Mar 31 18:06:15.300253 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 8/14] 10.222.0.58 () {64 vars in 1282 bytes} [Thu Mar 31 18:06:15 2022] POST /compute/v2.1/flavors => generated 404 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 31 18:06:15.321255 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-801e34ae-228a-4567-b565-a5709ff3fbd4 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:06:15.474600 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-801e34ae-228a-4567-b565-a5709ff3fbd4 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.165999 Mar 31 18:06:15.475065 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 7/15] 10.222.0.58 () {64 vars in 1335 bytes} [Thu Mar 31 18:06:15 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:06:18.132591 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-9e63a9e8-8b54-4a94-8f62-a5ce1962eea5 admin admin] Calling method '>' {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:06:18.134414 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-9e63a9e8-8b54-4a94-8f62-a5ce1962eea5 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002683 Mar 31 18:06:18.135362 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 9/16] 10.222.0.58 () {54 vars in 930 bytes} [Thu Mar 31 18:06:18 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 31 18:06:18.199221 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-dabd643a-c5d0-4ec1-b63e-70cb7bfb953b admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d4", "ram": 4096, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds4G", "disk": 20}} {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:06:18.292453 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-dabd643a-c5d0-4ec1-b63e-70cb7bfb953b admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.150851 Mar 31 18:06:18.293780 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 8/17] 10.222.0.58 () {64 vars in 1282 bytes} [Thu Mar 31 18:06:18 2022] POST /compute/v2.1/flavors => generated 404 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 31 18:06:18.306673 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-22169c6f-8d4c-4028-94b2-4de4512265b2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:06:18.401451 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-22169c6f-8d4c-4028-94b2-4de4512265b2 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098269 Mar 31 18:06:18.402503 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 10/18] 10.222.0.58 () {64 vars in 1335 bytes} [Thu Mar 31 18:06:18 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:06:20.847512 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-dabd643a-c5d0-4ec1-b63e-70cb7bfb953b admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:06:20.848537 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-dabd643a-c5d0-4ec1-b63e-70cb7bfb953b admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Mar 31 18:06:20.848943 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 9/19] 10.222.0.58 () {54 vars in 930 bytes} [Thu Mar 31 18:06:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:06:20.916273 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-81215356-917b-49fb-9d57-0123e3b187c7 admin admin] Calling method '>' {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:06:20.939668 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-81215356-917b-49fb-9d57-0123e3b187c7 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.081670 Mar 31 18:06:20.940323 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 11/20] 10.222.0.58 () {60 vars in 1291 bytes} [Thu Mar 31 18:06:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 31 18:06:23.398753 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-dabd643a-c5d0-4ec1-b63e-70cb7bfb953b admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:06:23.399859 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-dabd643a-c5d0-4ec1-b63e-70cb7bfb953b admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002193 Mar 31 18:06:23.400270 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 10/21] 10.222.0.58 () {54 vars in 930 bytes} [Thu Mar 31 18:06:23 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 31 18:06:23.462024 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-127c4e31-49a1-47ee-a1b8-377c11ef18b9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 1, "id": "1", "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 512, "name": "m1.tiny", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "vcpus": 1}} {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:06:23.546427 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-127c4e31-49a1-47ee-a1b8-377c11ef18b9 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.140284 Mar 31 18:06:23.547035 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 12/22] 10.222.0.58 () {64 vars in 1282 bytes} [Thu Mar 31 18:06:23 2022] POST /compute/v2.1/flavors => generated 402 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 31 18:06:23.560951 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-233412ea-aeb4-4ccf-bf0f-a7692b027114 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:06:23.735555 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-233412ea-aeb4-4ccf-bf0f-a7692b027114 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.178626 Mar 31 18:06:23.737161 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 11/23] 10.222.0.58 () {64 vars in 1332 bytes} [Thu Mar 31 18:06:23 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:06:26.803179 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-127c4e31-49a1-47ee-a1b8-377c11ef18b9 admin admin] Calling method '>' {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:06:26.804240 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-127c4e31-49a1-47ee-a1b8-377c11ef18b9 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001545 Mar 31 18:06:26.804617 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 13/24] 10.222.0.58 () {54 vars in 930 bytes} [Thu Mar 31 18:06:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:06:26.864373 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-a472bd23-b590-41fb-b512-d9020426d887 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "swap": 0, "ram": 2048, "os-flavor-access:is_public": true, "name": "m1.small", "id": "2", "rxtx_factor": 1.0, "vcpus": 1}} {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:06:26.937473 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-a472bd23-b590-41fb-b512-d9020426d887 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.126942 Mar 31 18:06:26.938392 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 12/25] 10.222.0.58 () {64 vars in 1282 bytes} [Thu Mar 31 18:06:26 2022] POST /compute/v2.1/flavors => generated 405 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 31 18:06:26.950194 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-29a0d1ab-8920-49e0-b28d-b18ff19c14e3 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:06:27.065094 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-29a0d1ab-8920-49e0-b28d-b18ff19c14e3 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.118511 Mar 31 18:06:27.066010 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 14/26] 10.222.0.58 () {64 vars in 1332 bytes} [Thu Mar 31 18:06:26 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:06:29.521263 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-a472bd23-b590-41fb-b512-d9020426d887 admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:06:29.522296 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-a472bd23-b590-41fb-b512-d9020426d887 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Mar 31 18:06:29.523011 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 13/27] 10.222.0.58 () {54 vars in 930 bytes} [Thu Mar 31 18:06:29 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:06:29.584332 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-1e0d35ea-7c48-46b4-9971-74f80ac321fa admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "os-flavor-access:is_public": true, "name": "m1.medium", "disk": 40, "ram": 4096, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "swap": 0}} {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:06:29.706899 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-1e0d35ea-7c48-46b4-9971-74f80ac321fa admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.178033 Mar 31 18:06:29.707390 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 15/28] 10.222.0.58 () {64 vars in 1282 bytes} [Thu Mar 31 18:06:29 2022] POST /compute/v2.1/flavors => generated 406 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 31 18:06:29.719125 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-608c0c89-0cc4-4c1a-97a5-b76a5347772f admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:06:29.795111 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-608c0c89-0cc4-4c1a-97a5-b76a5347772f admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079631 Mar 31 18:06:29.795719 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 14/29] 10.222.0.58 () {64 vars in 1332 bytes} [Thu Mar 31 18:06:29 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:06:32.195000 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-1e0d35ea-7c48-46b4-9971-74f80ac321fa admin admin] Calling method '>' {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:06:32.196015 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-1e0d35ea-7c48-46b4-9971-74f80ac321fa admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001516 Mar 31 18:06:32.196591 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 16/30] 10.222.0.58 () {54 vars in 930 bytes} [Thu Mar 31 18:06:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:06:32.262986 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-379fa5d0-7ec9-48e8-b8bf-58a0a373a8dd admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "id": "4", "vcpus": 4, "ram": 8192, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 80, "name": "m1.large", "rxtx_factor": 1.0}} {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:06:32.337927 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-379fa5d0-7ec9-48e8-b8bf-58a0a373a8dd admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.135479 Mar 31 18:06:32.338495 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 15/31] 10.222.0.58 () {64 vars in 1282 bytes} [Thu Mar 31 18:06:32 2022] POST /compute/v2.1/flavors => generated 405 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 31 18:06:32.352937 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-f4386919-85a1-4f5f-b33c-5015f78750d2 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:06:32.427591 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-f4386919-85a1-4f5f-b33c-5015f78750d2 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.080462 Mar 31 18:06:32.428244 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 17/32] 10.222.0.58 () {64 vars in 1332 bytes} [Thu Mar 31 18:06:32 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:06:34.883894 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-379fa5d0-7ec9-48e8-b8bf-58a0a373a8dd admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:06:34.884911 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-379fa5d0-7ec9-48e8-b8bf-58a0a373a8dd admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001502 Mar 31 18:06:34.885335 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 16/33] 10.222.0.58 () {54 vars in 930 bytes} [Thu Mar 31 18:06:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:06:34.949794 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-c63bf3ad-cb89-4f51-a3bc-f2f8e39573ad admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 160, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "name": "m1.xlarge", "ram": 16384, "id": "5", "vcpus": 8}} {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:06:35.092756 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-c63bf3ad-cb89-4f51-a3bc-f2f8e39573ad admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.201486 Mar 31 18:06:35.094916 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 18/34] 10.222.0.58 () {64 vars in 1282 bytes} [Thu Mar 31 18:06:34 2022] POST /compute/v2.1/flavors => generated 408 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 31 18:06:35.108577 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-e0d97b44-9142-467f-926b-37fec9a30503 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:06:35.204511 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-e0d97b44-9142-467f-926b-37fec9a30503 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.102321 Mar 31 18:06:35.206088 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 17/35] 10.222.0.58 () {64 vars in 1332 bytes} [Thu Mar 31 18:06:35 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:06:59.298398 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-c63bf3ad-cb89-4f51-a3bc-f2f8e39573ad admin admin] Calling method '>' {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:06:59.299446 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-c63bf3ad-cb89-4f51-a3bc-f2f8e39573ad admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Mar 31 18:06:59.300463 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 19/36] 10.222.0.58 () {54 vars in 930 bytes} [Thu Mar 31 18:06:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:06:59.355837 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-1fcb4a80-f857-4d36-baac-854e3ad0aee0 admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:06:59.373332 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-1fcb4a80-f857-4d36-baac-854e3ad0aee0 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.067124 Mar 31 18:06:59.373890 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 18/37] 10.222.0.58 () {60 vars in 1291 bytes} [Thu Mar 31 18:06:59 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:07:00.763076 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-c63bf3ad-cb89-4f51-a3bc-f2f8e39573ad admin admin] Calling method '>' {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:07:00.764083 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-c63bf3ad-cb89-4f51-a3bc-f2f8e39573ad admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001444 Mar 31 18:07:00.764486 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 20/38] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Mar 31 18:07:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:07:00.961474 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-6960ebd2-2119-498b-8cb6-a50d71584565 admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:07:00.966964 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.wsgi [None req-6960ebd2-2119-498b-8cb6-a50d71584565 admin admin] HTTP exception thrown: Flavor 42 could not be found. Mar 31 18:07:00.967526 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-6960ebd2-2119-498b-8cb6-a50d71584565 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:07:00.968320 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-6960ebd2-2119-498b-8cb6-a50d71584565 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.058290 Mar 31 18:07:00.968844 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 19/39] 10.222.0.58 () {60 vars in 1190 bytes} [Thu Mar 31 18:07:00 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 31 18:07:00.978257 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-592c8529-3ed9-4d88-bbac-f379c1b16063 admin admin] Calling method '>' {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:07:00.998899 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-592c8529-3ed9-4d88-bbac-f379c1b16063 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024193 Mar 31 18:07:00.999442 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 21/40] 10.222.0.58 () {60 vars in 1210 bytes} [Thu Mar 31 18:07:00 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 25 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:07:01.009643 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-f05701da-af75-4c5a-b1b6-ff685d399d02 admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:07:01.030737 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-f05701da-af75-4c5a-b1b6-ff685d399d02 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024623 Mar 31 18:07:01.031363 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 20/41] 10.222.0.58 () {60 vars in 1210 bytes} [Thu Mar 31 18:07:01 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:07:01.041082 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-82574112-e3a5-4525-91da-e18165e5e41f admin admin] Calling method '>' {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:07:01.046379 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.wsgi [None req-82574112-e3a5-4525-91da-e18165e5e41f admin admin] HTTP exception thrown: Flavor 42 could not be found. Mar 31 18:07:01.046969 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-82574112-e3a5-4525-91da-e18165e5e41f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:07:01.047749 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-82574112-e3a5-4525-91da-e18165e5e41f admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.010231 Mar 31 18:07:01.048243 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 22/42] 10.222.0.58 () {60 vars in 1190 bytes} [Thu Mar 31 18:07:01 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 11 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 31 18:07:02.325078 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-f05701da-af75-4c5a-b1b6-ff685d399d02 admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:07:02.326077 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-f05701da-af75-4c5a-b1b6-ff685d399d02 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Mar 31 18:07:02.326479 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 21/43] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Mar 31 18:07:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:07:02.516656 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-836b6d1e-15fc-4396-a6be-d599e416b9da admin admin] Calling method '>' {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:07:02.523186 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.wsgi [None req-836b6d1e-15fc-4396-a6be-d599e416b9da admin admin] HTTP exception thrown: Flavor 84 could not be found. Mar 31 18:07:02.523738 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-836b6d1e-15fc-4396-a6be-d599e416b9da admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:07:02.524514 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-836b6d1e-15fc-4396-a6be-d599e416b9da admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.059356 Mar 31 18:07:02.525017 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 23/44] 10.222.0.58 () {60 vars in 1190 bytes} [Thu Mar 31 18:07:02 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 31 18:07:02.534754 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-6f5fba46-3d1f-4e83-9c38-648966e8fa81 admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:07:02.548100 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-6f5fba46-3d1f-4e83-9c38-648966e8fa81 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017447 Mar 31 18:07:02.548629 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 22/45] 10.222.0.58 () {60 vars in 1210 bytes} [Thu Mar 31 18:07:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:07:02.558214 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-a62509e3-ff3e-4f9e-943b-c740e270edd4 admin admin] Calling method '>' {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:07:02.572399 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-a62509e3-ff3e-4f9e-943b-c740e270edd4 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017626 Mar 31 18:07:02.572869 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 24/46] 10.222.0.58 () {60 vars in 1210 bytes} [Thu Mar 31 18:07:02 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:07:02.582349 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-7c0b96b6-148f-4c79-8f0d-0f7e6bdd2e08 admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:07:02.587592 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.wsgi [None req-7c0b96b6-148f-4c79-8f0d-0f7e6bdd2e08 admin admin] HTTP exception thrown: Flavor 84 could not be found. Mar 31 18:07:02.588145 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-7c0b96b6-148f-4c79-8f0d-0f7e6bdd2e08 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:07:02.590202 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-7c0b96b6-148f-4c79-8f0d-0f7e6bdd2e08 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.010691 Mar 31 18:07:02.590202 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 23/47] 10.222.0.58 () {60 vars in 1190 bytes} [Thu Mar 31 18:07:02 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 31 18:07:03.850185 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-a62509e3-ff3e-4f9e-943b-c740e270edd4 admin admin] Calling method '>' {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:07:03.851225 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-a62509e3-ff3e-4f9e-943b-c740e270edd4 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001471 Mar 31 18:07:03.851631 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 25/48] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Mar 31 18:07:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:07:04.041362 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-7d9c6954-6794-4a3f-8626-f2b506140da7 admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:07:04.046533 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.wsgi [None req-7d9c6954-6794-4a3f-8626-f2b506140da7 admin admin] HTTP exception thrown: Flavor 451 could not be found. Mar 31 18:07:04.047127 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-7d9c6954-6794-4a3f-8626-f2b506140da7 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103154) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:07:04.047913 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-7d9c6954-6794-4a3f-8626-f2b506140da7 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.058672 Mar 31 18:07:04.048431 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 24/49] 10.222.0.58 () {60 vars in 1193 bytes} [Thu Mar 31 18:07:03 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Mar 31 18:07:04.058509 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-0c871ed5-e058-47ad-8392-b856f882a4ce admin admin] Calling method '>' {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:07:04.072155 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-0c871ed5-e058-47ad-8392-b856f882a4ce admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017226 Mar 31 18:07:04.072698 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 26/50] 10.222.0.58 () {60 vars in 1210 bytes} [Thu Mar 31 18:07:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:07:04.082767 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-0e29e940-46f7-4a87-8259-bec5e3d1c46a admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:07:04.095942 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-0e29e940-46f7-4a87-8259-bec5e3d1c46a admin admin] 10.222.0.58 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017254 Mar 31 18:07:04.096483 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 25/51] 10.222.0.58 () {60 vars in 1210 bytes} [Thu Mar 31 18:07:04 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:07:04.106126 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-79e36f5b-9657-4c94-9ad7-cb85a3f565e3 admin admin] Calling method '>' {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:07:04.111342 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.wsgi [None req-79e36f5b-9657-4c94-9ad7-cb85a3f565e3 admin admin] HTTP exception thrown: Flavor 451 could not be found. Mar 31 18:07:04.111901 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-79e36f5b-9657-4c94-9ad7-cb85a3f565e3 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103153) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:07:04.113479 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-79e36f5b-9657-4c94-9ad7-cb85a3f565e3 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.010313 Mar 31 18:07:04.113986 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 27/52] 10.222.0.58 () {60 vars in 1193 bytes} [Thu Mar 31 18:07:04 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Mar 31 18:07:05.387698 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-0e29e940-46f7-4a87-8259-bec5e3d1c46a admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:07:05.388716 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-0e29e940-46f7-4a87-8259-bec5e3d1c46a admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Mar 31 18:07:05.389141 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 26/53] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Mar 31 18:07:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:07:05.578262 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-ad88e120-5605-4b57-bffa-e1fb13827037 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:07:05.641832 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-ad88e120-5605-4b57-bffa-e1fb13827037 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.113990 Mar 31 18:07:05.642360 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 28/54] 10.222.0.58 () {64 vars in 1235 bytes} [Thu Mar 31 18:07:05 2022] POST /compute/v2.1/flavors => generated 404 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 31 18:07:06.920335 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-0e29e940-46f7-4a87-8259-bec5e3d1c46a admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:07:06.921343 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-0e29e940-46f7-4a87-8259-bec5e3d1c46a admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Mar 31 18:07:06.921745 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 27/55] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Mar 31 18:07:06 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:07:07.111250 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-d00fc46c-1dc7-4ea5-b650-253e8de6cd60 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:07:07.184310 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-d00fc46c-1dc7-4ea5-b650-253e8de6cd60 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.124656 Mar 31 18:07:07.184796 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 29/56] 10.222.0.58 () {64 vars in 1235 bytes} [Thu Mar 31 18:07:07 2022] POST /compute/v2.1/flavors => generated 405 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 31 18:07:08.458133 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-0e29e940-46f7-4a87-8259-bec5e3d1c46a admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:07:08.459268 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-0e29e940-46f7-4a87-8259-bec5e3d1c46a admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001768 Mar 31 18:07:08.459673 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 28/57] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Mar 31 18:07:08 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:07:08.653034 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-70fe05fb-ef5d-4ed4-845a-3fc5104b9487 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:07:08.746915 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-70fe05fb-ef5d-4ed4-845a-3fc5104b9487 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.147323 Mar 31 18:07:08.747493 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 30/58] 10.222.0.58 () {64 vars in 1235 bytes} [Thu Mar 31 18:07:08 2022] POST /compute/v2.1/flavors => generated 407 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 31 18:07:10.016453 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-0e29e940-46f7-4a87-8259-bec5e3d1c46a admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:07:10.017459 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-0e29e940-46f7-4a87-8259-bec5e3d1c46a admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001636 Mar 31 18:07:10.017925 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 29/59] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Mar 31 18:07:10 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:07:10.230564 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-57cc5813-4576-48c6-aca4-8a0d5b9a4768 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:07:10.358740 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-57cc5813-4576-48c6-aca4-8a0d5b9a4768 admin admin] 10.222.0.58 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.202762 Mar 31 18:07:10.359295 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 31/60] 10.222.0.58 () {64 vars in 1235 bytes} [Thu Mar 31 18:07:10 2022] POST /compute/v2.1/flavors => generated 409 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 31 18:07:11.619278 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-0e29e940-46f7-4a87-8259-bec5e3d1c46a admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:07:11.620286 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-0e29e940-46f7-4a87-8259-bec5e3d1c46a admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001454 Mar 31 18:07:11.620693 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 30/61] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Mar 31 18:07:11 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:07:11.809905 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-08d02ec8-75bf-41a5-b0e6-6d930bd2ad5f admin admin] Calling method '>' {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:07:11.829244 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-08d02ec8-75bf-41a5-b0e6-6d930bd2ad5f admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071314 Mar 31 18:07:11.829740 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 32/62] 10.222.0.58 () {60 vars in 1202 bytes} [Thu Mar 31 18:07:11 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:08:02.559877 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-0e29e940-46f7-4a87-8259-bec5e3d1c46a admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:08:02.560888 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-0e29e940-46f7-4a87-8259-bec5e3d1c46a admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Mar 31 18:08:02.561292 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 31/63] 10.222.0.58 () {54 vars in 930 bytes} [Thu Mar 31 18:08:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:08:02.618786 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-ec1e6307-6530-454e-85aa-78720c47f254 admin admin] Calling method '>' {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:08:02.639353 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-ec1e6307-6530-454e-85aa-78720c47f254 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.072032 Mar 31 18:08:02.639892 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 33/64] 10.222.0.58 () {60 vars in 1291 bytes} [Thu Mar 31 18:08:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:08:02.662429 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-d1a0e8ff-74b9-4dd5-abce-05c9703e89d2 admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:08:02.669943 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-d1a0e8ff-74b9-4dd5-abce-05c9703e89d2 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011271 Mar 31 18:08:02.670472 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 32/65] 10.222.0.58 () {60 vars in 1282 bytes} [Thu Mar 31 18:08:02 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:08:02.681482 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-460a8221-2e33-46ca-87a4-fb59f4300e0c admin admin] Calling method '>' {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:08:02.688941 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-460a8221-2e33-46ca-87a4-fb59f4300e0c admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010986 Mar 31 18:08:02.689466 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 34/66] 10.222.0.58 () {60 vars in 1285 bytes} [Thu Mar 31 18:08:02 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:08:02.701464 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-4a5e3b35-3d2b-4142-9e78-24de075d0e4f admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:08:02.709441 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-4a5e3b35-3d2b-4142-9e78-24de075d0e4f admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011757 Mar 31 18:08:02.709974 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 33/67] 10.222.0.58 () {60 vars in 1285 bytes} [Thu Mar 31 18:08:02 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:08:02.720851 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-0ac4c48c-f7d7-4b7c-9bdd-868c54396486 admin admin] Calling method '>' {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:08:02.728295 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-0ac4c48c-f7d7-4b7c-9bdd-868c54396486 admin admin] 10.222.0.58 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010961 Mar 31 18:08:02.728809 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 35/68] 10.222.0.58 () {60 vars in 1282 bytes} [Thu Mar 31 18:08:02 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:09:44.034412 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-48c485b9-fff0-49d5-b6a0-75f5334c7f06 tempest-verify_tempest_config-577996340 tempest-verify_tempest_config-577996340-project] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:09:44.036457 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-48c485b9-fff0-49d5-b6a0-75f5334c7f06 tempest-verify_tempest_config-577996340 tempest-verify_tempest_config-577996340-project] 10.222.0.58 "GET /compute/v2.1/extensions" status: 200 len: 22700 microversion: 2.1 time: 0.108221 Mar 31 18:09:44.036998 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 34/69] 10.222.0.58 () {58 vars in 1133 bytes} [Thu Mar 31 18:09:43 2022] GET /compute/v2.1/extensions => generated 22700 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 31 18:11:30.869172 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-0ac4c48c-f7d7-4b7c-9bdd-868c54396486 admin admin] Calling method '>' {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:11:30.870211 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-0ac4c48c-f7d7-4b7c-9bdd-868c54396486 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Mar 31 18:11:30.870631 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 36/70] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Mar 31 18:11:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:11:31.129808 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-cddc4921-232f-4640-92b3-0d30f7326815 admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:11:31.131038 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 31 18:11:31.131038 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: warnings.warn(msg) Mar 31 18:11:31.132234 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG oslo_concurrency.lockutils [None req-cddc4921-232f-4640-92b3-0d30f7326815 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:11:31.132671 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG oslo_concurrency.lockutils [None req-cddc4921-232f-4640-92b3-0d30f7326815 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:11:31.133446 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG oslo_concurrency.lockutils [None req-cddc4921-232f-4640-92b3-0d30f7326815 admin admin] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:11:31.133867 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG oslo_concurrency.lockutils [None req-cddc4921-232f-4640-92b3-0d30f7326815 admin admin] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:11:31.167750 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-cddc4921-232f-4640-92b3-0d30f7326815 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.155009 Mar 31 18:11:31.168324 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 35/71] 10.222.0.58 () {60 vars in 1193 bytes} [Thu Mar 31 18:11:31 2022] GET /compute/v2.1/os-services => generated 791 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 31 18:11:32.450159 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-0ac4c48c-f7d7-4b7c-9bdd-868c54396486 admin admin] Calling method '>' {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:11:32.451261 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-0ac4c48c-f7d7-4b7c-9bdd-868c54396486 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001493 Mar 31 18:11:32.451665 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 37/72] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Mar 31 18:11:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:11:32.643578 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-93e9f94b-a0ef-40b5-9275-7f3d205e1003 admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:11:32.644784 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 31 18:11:32.644784 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: warnings.warn(msg) Mar 31 18:11:32.646649 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG oslo_concurrency.lockutils [None req-93e9f94b-a0ef-40b5-9275-7f3d205e1003 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:11:32.647094 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG oslo_concurrency.lockutils [None req-93e9f94b-a0ef-40b5-9275-7f3d205e1003 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:11:32.647906 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG oslo_concurrency.lockutils [None req-93e9f94b-a0ef-40b5-9275-7f3d205e1003 admin admin] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:11:32.648342 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG oslo_concurrency.lockutils [None req-93e9f94b-a0ef-40b5-9275-7f3d205e1003 admin admin] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:11:32.669224 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-93e9f94b-a0ef-40b5-9275-7f3d205e1003 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.077755 Mar 31 18:11:32.669785 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 36/73] 10.222.0.58 () {60 vars in 1193 bytes} [Thu Mar 31 18:11:32 2022] GET /compute/v2.1/os-services => generated 791 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 31 18:11:44.410764 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-0ac4c48c-f7d7-4b7c-9bdd-868c54396486 admin admin] Calling method '>' {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:11:44.411861 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-0ac4c48c-f7d7-4b7c-9bdd-868c54396486 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Mar 31 18:11:44.412806 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 38/74] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Mar 31 18:11:44 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:11:44.613486 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-4f742b0f-6fac-45cb-8cc5-7d44b64ad65f admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:11:44.614671 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 31 18:11:44.614671 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: warnings.warn(msg) Mar 31 18:11:44.615949 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG oslo_concurrency.lockutils [None req-4f742b0f-6fac-45cb-8cc5-7d44b64ad65f admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:11:44.616382 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG oslo_concurrency.lockutils [None req-4f742b0f-6fac-45cb-8cc5-7d44b64ad65f admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:11:44.617153 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG oslo_concurrency.lockutils [None req-4f742b0f-6fac-45cb-8cc5-7d44b64ad65f admin admin] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:11:44.617576 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG oslo_concurrency.lockutils [None req-4f742b0f-6fac-45cb-8cc5-7d44b64ad65f admin admin] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:11:44.643310 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-4f742b0f-6fac-45cb-8cc5-7d44b64ad65f admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.083196 Mar 31 18:11:44.643798 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 37/75] 10.222.0.58 () {60 vars in 1193 bytes} [Thu Mar 31 18:11:44 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:11:45.940915 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: DEBUG nova.api.openstack.wsgi [None req-0ac4c48c-f7d7-4b7c-9bdd-868c54396486 admin admin] Calling method '>' {{(pid=103153) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:11:45.941926 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: INFO nova.api.openstack.requestlog [None req-0ac4c48c-f7d7-4b7c-9bdd-868c54396486 admin admin] 10.222.0.58 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001440 Mar 31 18:11:45.942332 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: [pid: 103153|app: 0|req: 39/76] 10.222.0.58 () {56 vars in 1074 bytes} [Thu Mar 31 18:11:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:11:46.137153 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG nova.api.openstack.wsgi [None req-c3c62aaf-e299-4fc2-a6b2-47d6bdc536d4 admin admin] Calling method '>' {{(pid=103154) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:11:46.138334 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1119: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Mar 31 18:11:46.138334 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: warnings.warn(msg) Mar 31 18:11:46.139565 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG oslo_concurrency.lockutils [None req-c3c62aaf-e299-4fc2-a6b2-47d6bdc536d4 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:11:46.140015 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG oslo_concurrency.lockutils [None req-c3c62aaf-e299-4fc2-a6b2-47d6bdc536d4 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:11:46.140811 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG oslo_concurrency.lockutils [None req-c3c62aaf-e299-4fc2-a6b2-47d6bdc536d4 admin admin] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:11:46.141248 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: DEBUG oslo_concurrency.lockutils [None req-c3c62aaf-e299-4fc2-a6b2-47d6bdc536d4 admin admin] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103154) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:11:46.165178 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: INFO nova.api.openstack.requestlog [None req-c3c62aaf-e299-4fc2-a6b2-47d6bdc536d4 admin admin] 10.222.0.58 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.90 time: 0.080200 Mar 31 18:11:46.165775 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: [pid: 103154|app: 0|req: 38/77] 10.222.0.58 () {60 vars in 1193 bytes} [Thu Mar 31 18:11:46 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:12:50.695080 dv-cinder-master-3-iscsi devstack@n-api.service[103152]: Thu Mar 31 18:12:50 2022 - graceful shutdown triggered... Mar 31 18:12:50.695200 dv-cinder-master-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Mar 31 18:12:50.696883 dv-cinder-master-3-iscsi devstack@n-api.service[103154]: Gracefully killing worker 2 (pid: 103154)... Mar 31 18:12:50.697314 dv-cinder-master-3-iscsi devstack@n-api.service[103153]: Gracefully killing worker 1 (pid: 103153)... Mar 31 18:12:51.696654 dv-cinder-master-3-iscsi devstack@n-api.service[103152]: worker 1 buried after 1 seconds Mar 31 18:12:51.696654 dv-cinder-master-3-iscsi devstack@n-api.service[103152]: worker 2 buried after 1 seconds Mar 31 18:12:51.696654 dv-cinder-master-3-iscsi devstack@n-api.service[103152]: goodbye to uWSGI. Mar 31 18:12:51.698581 dv-cinder-master-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Mar 31 18:12:51.699178 dv-cinder-master-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Mar 31 18:12:51.701889 dv-cinder-master-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Mar 31 18:12:51.715054 dv-cinder-master-3-iscsi devstack@n-api.service[117523]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Mar 31 18:12:51.717647 dv-cinder-master-3-iscsi devstack@n-api.service[117523]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Mar 31 18:12:51 2022] *** Mar 31 18:12:51.717647 dv-cinder-master-3-iscsi devstack@n-api.service[117523]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Mar 31 18:12:51.717647 dv-cinder-master-3-iscsi devstack@n-api.service[117523]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Mar 31 18:12:51.717647 dv-cinder-master-3-iscsi devstack@n-api.service[117523]: nodename: dv-cinder-master-3-iscsi Mar 31 18:12:51.717647 dv-cinder-master-3-iscsi devstack@n-api.service[117523]: machine: x86_64 Mar 31 18:12:51.717647 dv-cinder-master-3-iscsi devstack@n-api.service[117523]: clock source: unix Mar 31 18:12:51.717647 dv-cinder-master-3-iscsi devstack@n-api.service[117523]: pcre jit disabled Mar 31 18:12:51.717647 dv-cinder-master-3-iscsi devstack@n-api.service[117523]: detected number of CPU cores: 4 Mar 31 18:12:51.717647 dv-cinder-master-3-iscsi devstack@n-api.service[117523]: current working directory: / Mar 31 18:12:51.717647 dv-cinder-master-3-iscsi devstack@n-api.service[117523]: detected binary path: /usr/bin/uwsgi-core Mar 31 18:12:51.717647 dv-cinder-master-3-iscsi devstack@n-api.service[117523]: your processes number limit is 47680 Mar 31 18:12:51.718512 dv-cinder-master-3-iscsi devstack@n-api.service[117523]: your memory page size is 4096 bytes Mar 31 18:12:51.718512 dv-cinder-master-3-iscsi devstack@n-api.service[117523]: detected max file descriptor number: 2048 Mar 31 18:12:51.718512 dv-cinder-master-3-iscsi devstack@n-api.service[117523]: lock engine: pthread robust mutexes Mar 31 18:12:51.718512 dv-cinder-master-3-iscsi devstack@n-api.service[117523]: thunder lock: enabled Mar 31 18:12:51.718512 dv-cinder-master-3-iscsi devstack@n-api.service[117523]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Mar 31 18:12:51.718512 dv-cinder-master-3-iscsi devstack@n-api.service[117523]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Mar 31 18:12:51.764895 dv-cinder-master-3-iscsi devstack@n-api.service[117523]: Python main interpreter initialized at 0x5624797709c0 Mar 31 18:12:51.764895 dv-cinder-master-3-iscsi devstack@n-api.service[117523]: python threads support enabled Mar 31 18:12:51.764895 dv-cinder-master-3-iscsi devstack@n-api.service[117523]: your server socket listen backlog is limited to 100 connections Mar 31 18:12:51.764895 dv-cinder-master-3-iscsi devstack@n-api.service[117523]: your mercy for graceful operations on workers is 90 seconds Mar 31 18:12:51.765379 dv-cinder-master-3-iscsi devstack@n-api.service[117523]: mapped 403077 bytes (393 KB) for 2 cores Mar 31 18:12:51.765379 dv-cinder-master-3-iscsi devstack@n-api.service[117523]: *** Operational MODE: preforking *** Mar 31 18:12:51.765614 dv-cinder-master-3-iscsi devstack@n-api.service[117523]: *** uWSGI is running in multiple interpreter mode *** Mar 31 18:12:51.765614 dv-cinder-master-3-iscsi devstack@n-api.service[117523]: spawned uWSGI master process (pid: 117523) Mar 31 18:12:51.765828 dv-cinder-master-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Mar 31 18:12:51.770483 dv-cinder-master-3-iscsi devstack@n-api.service[117523]: spawned uWSGI worker 1 (pid: 117538, cores: 1) Mar 31 18:12:51.770483 dv-cinder-master-3-iscsi devstack@n-api.service[117523]: spawned uWSGI worker 2 (pid: 117539, cores: 1) Mar 31 18:12:51.770483 dv-cinder-master-3-iscsi devstack@n-api.service[117523]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Mar 31 18:12:52.961163 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Mar 31 18:12:53.011880 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Mar 31 18:12:53.889345 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 31 18:12:53.889345 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: from cryptography.utils import int_from_bytes Mar 31 18:12:53.889674 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 31 18:12:53.889674 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: from cryptography.utils import int_from_bytes Mar 31 18:12:53.955611 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 31 18:12:53.955611 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: from cryptography.utils import int_from_bytes Mar 31 18:12:53.956023 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Mar 31 18:12:53.956023 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: from cryptography.utils import int_from_bytes Mar 31 18:12:56.403011 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 31 18:12:56.403722 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 31 18:12:56.403841 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 31 18:12:56.404140 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 31 18:12:56.404407 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 31 18:12:56.404791 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.405123 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.405450 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.405772 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.406110 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.406422 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.406769 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.407095 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.407427 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.407698 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.408011 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.408338 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-iscsi {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.408661 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.408972 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.409284 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.409606 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.409909 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.410231 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.410537 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.411067 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.412658 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.412658 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.412658 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.412658 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.413037 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.413037 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.413350 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.413673 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.413987 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.414305 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.414734 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-iscsi {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.415172 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.415527 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.415928 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.416152 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.416397 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.416713 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.417039 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.417358 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.417659 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.417991 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.418318 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.418643 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.418974 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.419531 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.419842 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.420158 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.420487 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.420789 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.421098 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.421355 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.421671 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.421991 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.422310 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.422654 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.422911 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.423167 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.423485 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.423808 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.424117 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.424427 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.424737 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.425046 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.425349 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.425657 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.425962 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.426269 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.426586 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.426927 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.427253 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.427564 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.427885 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.428291 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.428573 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.428853 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.429196 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.429532 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.429830 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.430165 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.431021 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.431371 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.431649 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.431944 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.432371 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.432606 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.432893 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.433150 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.433438 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.433740 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.434595 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.434595 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.434955 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.435132 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.435289 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.435569 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.436023 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.436185 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.436526 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.436835 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.437143 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.437452 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.437761 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.438066 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.438390 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.438732 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.439040 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.439347 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.439653 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.439961 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.440280 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.440587 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.440889 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.441211 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.441542 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.441822 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.442142 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.442511 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.442796 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.443120 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.443426 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.443733 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.444054 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.444364 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.444669 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.444974 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.445432 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.445627 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.445874 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.446804 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.447303 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.447611 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.447917 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.448337 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.448601 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.448841 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.449162 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.449543 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Mar 31 18:12:56.450148 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.450487 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Mar 31 18:12:56.450625 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.450625 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.450813 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Mar 31 18:12:56.450901 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.450999 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Mar 31 18:12:56.451092 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.451176 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Mar 31 18:12:56.451260 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.451370 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.451462 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.451671 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.451784 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.451882 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.452060 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.452196 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.452376 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.452524 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.452704 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.452834 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.453100 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.453239 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.453467 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.453560 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.453781 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.453879 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.454102 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.454201 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.454426 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.454527 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.454768 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-master-3-iscsi {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.454862 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.455090 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.455193 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.455396 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.455502 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.455709 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.455825 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.456016 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.456118 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.456326 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.456417 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.456647 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.456746 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.456953 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.457053 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.457272 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.457457 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.457617 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.457766 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.457964 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.458076 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.458290 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.458402 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.458633 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.458785 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.458955 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.459072 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.459340 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.459562 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.459657 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.459742 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.459876 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.459977 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.460201 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.460321 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.460506 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.460627 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.460831 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.460937 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-master-3-iscsi {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.461151 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.461257 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.461469 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.461577 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.461836 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.461959 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.462252 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.462363 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.462566 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.462777 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.462965 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.463089 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.463181 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.463296 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.463507 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.463642 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.463809 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.463976 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.464138 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.464269 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.464453 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.464583 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.464772 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.464913 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.465116 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.465245 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.465414 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.465502 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.465733 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.465825 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.466027 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.466162 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.466331 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.466443 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.466659 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.466763 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.466967 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.467092 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.467216 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.467305 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.467519 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.467656 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.467839 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.467950 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.468158 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.468248 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.468477 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.468570 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.468727 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.468856 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.469018 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.469118 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.469607 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.469717 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.469802 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(user_domain)s %(project_domain)s {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.469887 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.469993 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.470121 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.470230 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.470465 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.470945 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.471041 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.471379 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.471476 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.471550 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.471550 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.471776 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.471899 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.473219 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.473368 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.473450 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.473639 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.473763 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.473860 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.473974 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.474280 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.474409 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.474574 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.475416 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.475760 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.475899 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.475899 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.476179 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.58 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.476179 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.58 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.476545 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.476693 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.476813 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.476949 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.477044 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.477156 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.477973 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.478090 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.478251 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.478432 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.478657 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.478857 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.478954 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.479074 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.479175 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.479415 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.479525 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.479525 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.479686 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.479766 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.479845 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.479941 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.480036 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.480117 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.480227 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.480227 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.480402 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.480402 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.480625 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.480712 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.480812 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.480892 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.480966 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.481050 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.481138 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.481242 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.481325 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.481325 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.481469 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.481574 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.481672 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.481758 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.481854 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.481937 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.482017 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.482098 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.482181 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.482259 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.482358 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.482527 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.482710 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.482888 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.483013 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.483196 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.483345 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.483558 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.483672 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.483855 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.484007 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.484164 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.484423 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.484522 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.484770 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.484878 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.485087 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.485190 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.485407 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.485499 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.485713 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.485807 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.486025 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.486129 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.486339 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.486438 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.486672 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.486781 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.487000 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.487108 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.487317 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.487408 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.487637 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.487734 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.487946 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.488048 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.488274 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.488373 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.488577 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.488674 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.488897 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.489000 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.489205 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.489304 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.489523 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.489676 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.489844 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.490043 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.490242 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.490406 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.490595 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.490807 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.491017 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.491174 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.491353 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.491516 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.491677 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.491852 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.492045 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.492224 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.492377 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.492377 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.492688 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.492845 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.493095 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.493900 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.494181 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.494181 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.494509 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.494688 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.494927 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.494927 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.495228 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.495727 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.496612 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.497662 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Mar 31 18:12:56.497851 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.497851 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.498159 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.498320 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.498320 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.498756 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.498925 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.499077 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.499235 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.499235 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.499545 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.499720 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.499881 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.500041 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.500199 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.500350 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.500518 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.500683 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.500834 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.500991 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.500991 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.501277 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.501436 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.501587 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.501743 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.501901 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.502063 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.502214 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.502391 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.502573 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.502765 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.502939 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.503131 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.503294 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.503484 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.503663 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.503865 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.504043 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.504233 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.504430 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.504600 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.504759 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.504937 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.505099 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.505279 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.505460 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.505629 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.505805 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.505961 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.506136 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.506295 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.506455 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.506643 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.506818 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.506970 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.507145 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.507304 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.507472 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.507634 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.507784 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.507940 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.508113 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.508269 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.508433 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.508595 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.508788 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.508951 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.509137 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.509304 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.509456 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.509605 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.509756 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.509921 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.510079 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.510256 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.510426 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.510591 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.510779 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.510931 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.511088 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.511259 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.511410 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.511567 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.511726 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.511726 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.512037 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.512203 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.512382 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.512556 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.512712 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.512862 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.513021 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.513171 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.513330 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.513487 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.513648 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.513798 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.513976 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.514132 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.514302 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.514456 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.514645 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.514804 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.515011 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.515180 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.515343 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.515526 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.515686 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.515844 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.516004 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.516163 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.516322 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.516479 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.516638 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.516801 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.516801 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.517123 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.517283 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.517444 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.517593 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.517757 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.517908 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.518071 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.518230 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.518388 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.518556 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.518758 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.518917 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.519075 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.519225 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.519381 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.519549 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.519708 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.519867 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.520030 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.520193 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.520345 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.520494 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.520648 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.520819 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.520983 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.521173 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.521361 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.521528 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.521714 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.521881 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.522050 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.522216 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.522369 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.522525 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.522709 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.522880 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.523045 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.523196 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.523347 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.523506 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.523657 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.523821 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.523991 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.524161 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.524277 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.524371 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.524466 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.524553 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.524670 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.524759 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.524858 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.524943 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.525023 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.525103 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.525253 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.525340 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.525424 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.525514 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.525604 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.525696 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.525781 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.525870 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.525955 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.526038 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.526121 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.526216 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.526302 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.526392 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.526476 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.526582 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.526725 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.526827 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.526914 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.526997 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.527087 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.527171 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.527269 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.527372 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.527458 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.527541 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.527624 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.527708 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.527798 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.527884 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.527966 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.528055 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.528262 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.528435 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.528598 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.528751 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.528901 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.529050 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.529234 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.529397 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.529558 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.529710 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.529871 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.530022 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.530178 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.530331 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.530490 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.530672 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.530838 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.530989 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.531158 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.531319 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.531477 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.531652 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.531818 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.531991 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.532149 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.532318 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.532469 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.532620 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.532774 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.532925 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.533090 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.533260 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.533411 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.533569 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.533720 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.533884 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.534035 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.534195 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.534354 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.534505 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.534720 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.534886 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.535061 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.535224 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.535411 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.535563 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.535719 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.535876 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.536041 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.536199 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.536349 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.536505 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.536654 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.536803 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.536960 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.537118 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.537275 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.537443 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.537443 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.537728 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.537925 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.538104 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.538262 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.538429 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.538590 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.538784 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.538948 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.539100 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.539261 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.539422 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.539591 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.539755 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.540508 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.540873 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.541042 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.541194 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.541343 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.541506 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.541665 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.541816 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.541972 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.542122 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.542298 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.542462 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.542639 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.542807 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.542966 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.543124 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.543275 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.543442 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.543601 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.543751 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.543898 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.544046 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.544472 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.544635 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.544786 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.544947 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.545105 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.545264 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.545436 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.545599 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.545757 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.545924 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.546086 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.546256 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.546440 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.546653 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.546853 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.547021 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.547021 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.547308 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.547466 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.547626 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.547776 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.547932 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.548090 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.548253 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.548404 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.548563 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.548714 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.548873 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.549031 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.549195 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.549353 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.549504 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.549745 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.549909 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.550071 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.550247 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.550406 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.550564 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.550741 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.550892 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.551067 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.551228 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.551386 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.551536 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.551700 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.551877 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.552037 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.552204 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.552354 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.552530 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.552693 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.552850 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.553024 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.553175 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.553324 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.553482 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.553639 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.553798 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.554025 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.554186 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.554336 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.554484 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.554676 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.554836 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.554999 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.555173 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.555324 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.555495 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.556196 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.556365 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.556516 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.556666 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.556814 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.556965 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.557114 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.557271 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.557422 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.557611 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.557781 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.557781 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.558079 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.558256 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.558412 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.558587 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.558785 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.558944 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.559096 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.559255 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.559405 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.559562 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.559713 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.559872 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.560036 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.560189 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.560345 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.560495 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.560650 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.560808 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.560988 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.560988 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.561303 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.561465 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.561626 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.561801 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.561987 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.562145 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.562302 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.562452 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.562600 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.562792 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.562963 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.562963 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.563251 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.563400 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.563562 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.563727 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.563888 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.564082 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.564235 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.564399 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.564556 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.564707 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.564862 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.565014 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.565171 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.565335 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.565486 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.565635 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.565784 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.565959 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.566117 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.566280 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.566432 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.566588 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.566830 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.566982 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.567141 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.567300 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.567467 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.567618 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.567618 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.567909 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.568080 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.568241 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.568391 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.568541 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.568697 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.568855 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.569015 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.569173 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.569329 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.569480 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.569628 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.569787 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.569959 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.569959 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.570246 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.570394 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.570550 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.570740 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.570900 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.571059 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.571296 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.571296 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.571609 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.571777 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.571934 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.572103 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.572261 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.572419 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.572576 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.572753 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.572913 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.573064 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.573212 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.573212 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.573513 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.573664 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.573815 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.573963 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.574122 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.574270 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.574428 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.574585 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.574784 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.574954 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.575104 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.575261 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.575423 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.575574 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.575722 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.575871 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.575871 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.576184 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.576343 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.576502 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.576661 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.576818 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.576976 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.577145 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.577296 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.577446 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.577594 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.577751 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.577901 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.578079 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.578229 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.578378 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.578534 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.578725 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.578894 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.579056 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.579208 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.579364 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.579513 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.579661 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.579809 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.579968 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.580137 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.580288 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.580445 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.580595 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.580753 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.580903 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.581053 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.581218 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.581372 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.581529 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.581689 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.581841 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.581989 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.582160 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.582311 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.582468 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.582745 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.582906 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.583063 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.583215 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.583364 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.583513 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.583672 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.583823 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.583973 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.584121 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.584289 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.584473 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.584628 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.584778 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.584927 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.585078 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.585240 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.585400 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.585558 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.585708 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.585855 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.585855 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.586151 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.586311 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.586461 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.586641 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.586824 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.587003 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.587157 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.587321 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.587473 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.587631 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.587789 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.587939 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.588097 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.588258 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.588416 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.588577 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.588727 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.588876 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.589034 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.589184 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.589332 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.589482 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.589638 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.589790 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.589975 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.590135 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.590298 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.590447 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.590598 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.590788 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.590953 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.590953 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.591265 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.591424 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.591583 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.591743 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.591901 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.592051 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.592219 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.592369 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.592524 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.592689 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.592849 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.592849 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.593156 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.593313 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.593476 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.593627 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.593786 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.593944 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.594098 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.594267 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.594418 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.594575 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.594786 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.594948 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.595099 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.595257 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.595408 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.595557 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.595706 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.595878 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.596031 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.596194 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.596356 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.596516 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.596666 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.596823 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.596973 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.597131 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.597281 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.597429 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.597578 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.597734 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.597893 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.598043 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.598200 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.598362 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.598511 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.598680 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.598788 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.598873 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.598873 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.599051 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.599139 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.599223 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.599317 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.599405 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.599497 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.599589 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.599676 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.599762 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.599855 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.599943 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.600035 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.600129 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.600215 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.600313 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.600400 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.600492 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.600591 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.600591 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.600747 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.600840 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.600934 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.601020 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.601111 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.601198 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.601198 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.601360 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.601360 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.601516 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.601516 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.601684 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.601844 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.601844 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.602001 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.602088 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.602180 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.602273 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.602273 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.603002 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.603346 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.603450 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.603660 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.603929 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.604080 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.604296 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.604391 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.604693 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.604792 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.605005 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.605102 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.605312 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.605437 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.605615 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.605787 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.605925 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.606126 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.606250 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.606481 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.606573 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.606863 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.606971 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.607167 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.607270 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.607491 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.607583 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.607795 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.607897 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.608115 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.608208 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.608522 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.608613 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.608831 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.608930 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.609307 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.609402 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.609549 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.609681 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.609883 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.610006 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.610146 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.610352 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.610454 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.610711 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.610808 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.611112 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.611421 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.611582 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.611735 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.611841 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.612043 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.612290 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.612390 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.612665 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.612773 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.612969 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.613062 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.613281 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.613397 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.613586 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.613701 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.613907 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.614014 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.614228 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.614380 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.614524 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.614728 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.614873 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.614990 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.615283 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.615389 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.615607 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.615715 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.615916 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.616016 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.616235 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.616329 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.616565 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.616671 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.616868 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.616961 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.617169 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.617262 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.617475 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.617778 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.617879 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.618709 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.618852 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.619035 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.619288 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.619393 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.619633 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.619733 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.619939 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.620038 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.620248 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.620348 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.620551 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.620650 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.620851 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.620952 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.621173 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.621267 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.621479 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.621611 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.621803 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.621905 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.622114 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.622220 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.622434 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.622531 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.622777 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.622908 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.623079 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.623184 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.623400 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.623526 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.623706 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.623808 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.624010 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.624111 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.624308 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.624408 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.624611 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.624715 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.624936 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.625067 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.625242 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.625347 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.625553 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.625671 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.625867 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.625968 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.626176 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.626276 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.626513 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.626627 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.626821 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.626936 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.627131 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.627264 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.627449 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.627544 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.627757 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.627886 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.628069 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.628171 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.628370 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.628495 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.628671 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.628764 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.629017 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.629118 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.629278 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.629379 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.629606 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.629702 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.629884 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.630029 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.630187 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.630341 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.630485 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.630726 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.630875 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.631031 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.631130 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.631324 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.631437 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.631661 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.631765 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.631977 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.632072 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.632297 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.632434 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.632616 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.632733 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.632916 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.633014 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.633219 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.633492 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.633596 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.633908 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.634057 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.634232 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.634481 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.634584 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.634700 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.634892 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.634986 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.635221 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.635316 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.635534 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.635636 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.635847 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.635951 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.636164 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.636255 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.636477 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.636576 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.636807 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.636903 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.637105 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.637196 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.637415 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.637520 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.637730 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.637821 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.638040 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.638139 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.638346 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.638452 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.638682 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.638831 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.638997 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.639107 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.639308 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.639467 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.639618 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.639866 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.639991 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.640201 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.640308 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.640521 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.640648 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.640839 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.640972 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.641155 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.641294 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.641470 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.641622 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.641788 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.641944 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.642112 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.642260 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.642401 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.642574 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.642805 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.642906 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.643040 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.643221 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.643368 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.643514 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.643691 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.643849 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.644020 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.644165 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.644357 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.644461 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.644677 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.644892 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.645001 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.645207 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.645302 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.645529 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.645631 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.645920 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.646017 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.646164 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.646260 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.646490 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.646591 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.646840 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.646937 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.647170 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.647276 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.647480 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.647575 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.647793 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.647894 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.648103 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.648197 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.648417 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.648526 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.648733 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.648835 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.649046 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.649148 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.649390 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.649524 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.649702 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.649869 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.650016 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.650140 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.650342 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.650446 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.650699 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.650808 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.651025 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.651119 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.651341 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.651435 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.651655 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.651762 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.652034 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.652135 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.652406 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.652506 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.652776 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.652886 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.653073 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.653182 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.653334 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.653431 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.653646 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.653739 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.653959 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.654167 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.654329 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.654579 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.654754 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.654908 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.655056 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.655229 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.655369 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.655514 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.655673 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.655916 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.656096 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.656257 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.656420 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.656563 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.656701 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.656842 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.656982 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.657136 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.657276 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.657417 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.657564 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.657705 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.657844 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.657992 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.658133 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.658293 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.658452 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.658596 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.658824 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.658977 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.659166 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.659336 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.659506 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.659616 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.659791 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.659931 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.660086 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.660254 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.660426 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.660569 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.660731 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.660933 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.661092 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.661241 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.661398 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.661569 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.661729 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.661891 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.662094 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.662242 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.662411 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.662576 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.662705 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.662822 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.662995 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.663147 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.663267 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.663477 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.663573 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.663784 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.663879 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.664121 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.664214 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.664434 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.664530 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.664759 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.665371 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.665604 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.665770 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.665966 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.666104 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.666313 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.666411 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.666666 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.666831 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.666979 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.667073 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.667292 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.667380 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.667600 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.667703 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.667905 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.668007 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.668217 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.668324 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.668521 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.668629 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.668828 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.668924 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.669392 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.669493 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.669708 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.669803 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.670011 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.670105 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.670317 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.670420 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.670706 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.670814 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.671031 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.671132 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.671337 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.671435 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.671641 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.671739 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.671955 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.672062 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.672267 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.672372 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.672537 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117539) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 31 18:12:56.672653 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.672883 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.673195 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.673539 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.673854 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.674391 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.674748 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.675068 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.675401 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.675730 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.676036 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.676339 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.676644 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.676966 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.677281 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.677591 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.677899 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.678205 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.678513 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.678844 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.679152 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.679458 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.679764 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.680071 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.680379 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.680778 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.681096 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.681612 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.681935 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.682254 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.682572 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.682912 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.683228 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.683540 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.683848 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.684156 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.684469 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.684800 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.685111 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.685416 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.685838 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.686150 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.686465 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.686814 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.687123 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.687455 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.687777 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.688089 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.688404 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.688711 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.689043 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.689383 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.689711 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.690038 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.690342 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.690664 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.691078 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.691394 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.691717 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.692027 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.692415 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.692750 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.692911 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.693342 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.693516 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.693816 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.694120 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.694425 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.694753 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.695059 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.695356 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.695656 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.695956 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.696825 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.697379 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.697483 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_db.sqlalchemy.engines [None req-791b770e-af5b-49c8-9c72-5cc204d225c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117539) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 31 18:12:56.697701 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.698020 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.698324 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.698718 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.698945 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.699285 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.699619 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.699933 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.700251 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.700563 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.700998 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.701310 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.701630 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.701948 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.702263 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.702570 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.702928 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.703261 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.703597 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.703952 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.704281 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.704697 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.704932 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.705262 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.705586 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.705894 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.706216 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.706533 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.706881 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.707194 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.707505 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.707841 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.708153 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.708464 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.708779 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.709090 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.709399 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.709713 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.710028 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.710355 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.710699 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.711027 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.711352 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.711699 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.712757 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.713108 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.713437 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.713758 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.714068 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.714377 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Mar 31 18:12:56.714629 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117538) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Mar 31 18:12:56.737350 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_db.sqlalchemy.engines [None req-b7743c5c-3600-4f83-9e9d-f775d5f07456 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117538) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 31 18:12:56.763511 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.context [None req-791b770e-af5b-49c8-9c72-5cc204d225c1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1ceefcae-4d4b-47f0-bf59-76eb32505fbe(cell1) {{(pid=117539) load_cells /opt/stack/nova/nova/context.py:464}} Mar 31 18:12:56.767809 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-791b770e-af5b-49c8-9c72-5cc204d225c1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:12:56.769385 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-791b770e-af5b-49c8-9c72-5cc204d225c1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:12:56.770203 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-791b770e-af5b-49c8-9c72-5cc204d225c1 None None] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:12:56.772180 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-791b770e-af5b-49c8-9c72-5cc204d225c1 None None] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:12:56.783526 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_db.sqlalchemy.engines [None req-791b770e-af5b-49c8-9c72-5cc204d225c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117539) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 31 18:12:56.784863 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_db.sqlalchemy.engines [None req-791b770e-af5b-49c8-9c72-5cc204d225c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117539) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 31 18:12:56.804939 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.context [None req-b7743c5c-3600-4f83-9e9d-f775d5f07456 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),1ceefcae-4d4b-47f0-bf59-76eb32505fbe(cell1) {{(pid=117538) load_cells /opt/stack/nova/nova/context.py:464}} Mar 31 18:12:56.809423 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b7743c5c-3600-4f83-9e9d-f775d5f07456 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:12:56.811046 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b7743c5c-3600-4f83-9e9d-f775d5f07456 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:12:56.811881 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b7743c5c-3600-4f83-9e9d-f775d5f07456 None None] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:12:56.813845 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b7743c5c-3600-4f83-9e9d-f775d5f07456 None None] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:12:56.825477 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_db.sqlalchemy.engines [None req-b7743c5c-3600-4f83-9e9d-f775d5f07456 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117538) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 31 18:12:56.826308 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_db.sqlalchemy.engines [None req-b7743c5c-3600-4f83-9e9d-f775d5f07456 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117538) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 31 18:12:56.944583 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_db.sqlalchemy.engines [None req-791b770e-af5b-49c8-9c72-5cc204d225c1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117539) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 31 18:12:56.987550 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_db.sqlalchemy.engines [None req-b7743c5c-3600-4f83-9e9d-f775d5f07456 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117538) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Mar 31 18:12:57.388208 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: WARNING keystonemiddleware.auth_token [None req-791b770e-af5b-49c8-9c72-5cc204d225c1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 31 18:12:57.394804 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: WARNING keystonemiddleware.auth_token [None req-791b770e-af5b-49c8-9c72-5cc204d225c1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 31 18:12:57.453449 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: WARNING keystonemiddleware.auth_token [None req-b7743c5c-3600-4f83-9e9d-f775d5f07456 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 31 18:12:57.461165 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: WARNING keystonemiddleware.auth_token [None req-b7743c5c-3600-4f83-9e9d-f775d5f07456 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 31 18:12:57.624264 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: WARNING keystonemiddleware.auth_token [None req-791b770e-af5b-49c8-9c72-5cc204d225c1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 31 18:12:57.629534 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: WARNING keystonemiddleware.auth_token [None req-791b770e-af5b-49c8-9c72-5cc204d225c1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 31 18:12:57.636891 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5624797709c0 pid: 117539 (default app) Mar 31 18:12:57.695383 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: WARNING keystonemiddleware.auth_token [None req-b7743c5c-3600-4f83-9e9d-f775d5f07456 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Mar 31 18:12:57.701532 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: WARNING keystonemiddleware.auth_token [None req-b7743c5c-3600-4f83-9e9d-f775d5f07456 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Mar 31 18:12:57.706976 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5624797709c0 pid: 117538 (default app) Mar 31 18:13:39.371158 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-c7e96450-a447-4971-ae11-0f8105ac11ea tempest-VolumesSnapshotsTestJSON-1942860377 tempest-VolumesSnapshotsTestJSON-1942860377-project] Action: 'create', calling method: .version_select at 0x7fa4d5102700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1697270"}} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:13:40.219234 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-41fddbf9-9ea2-4cb6-a446-2bd637299377 tempest-VolumesGetTestJSON-1687692381 tempest-VolumesGetTestJSON-1687692381-project] Action: 'create', calling method: .version_select at 0x7fa4d5100700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-2015875487", "metadata": {"Type": "work"}}} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:13:42.270407 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-c7e96450-a447-4971-ae11-0f8105ac11ea tempest-VolumesSnapshotsTestJSON-1942860377 tempest-VolumesSnapshotsTestJSON-1942860377-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 200 len: 342 microversion: 2.1 time: 4.434669 Mar 31 18:13:42.271373 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 1/1] 10.222.0.58 () {60 vars in 1154 bytes} [Thu Mar 31 18:13:37 2022] POST /compute/v2.1/os-volumes => generated 342 bytes in 4437 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Mar 31 18:13:42.340830 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-be6fb64d-f661-4fce-930a-5b02ecc6e8c2 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-898914177", "imageRef": "6241b999-6f6d-4076-88bc-345fa7386256", "flavorRef": "452", "networks": [{"uuid": "6c793ff7-2519-4ef7-8b41-f73ba7273780"}]}} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:13:42.448884 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.network.neutron [None req-be6fb64d-f661-4fce-930a-5b02ecc6e8c2 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] validate_networks() for [('6c793ff7-2519-4ef7-8b41-f73ba7273780', None, None, None, None, None)] {{(pid=117539) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 31 18:13:42.870594 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-41fddbf9-9ea2-4cb6-a446-2bd637299377 tempest-VolumesGetTestJSON-1687692381 tempest-VolumesGetTestJSON-1687692381-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 4.275828 Mar 31 18:13:42.871655 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 1/2] 10.222.0.58 () {60 vars in 1155 bytes} [Thu Mar 31 18:13:38 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 4278 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Mar 31 18:13:42.877370 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-cb269b76-0bb5-4820-80da-fac51e28d81c tempest-VolumesSnapshotsTestJSON-1942860377 tempest-VolumesSnapshotsTestJSON-1942860377-project] Calling method '.version_select at 0x7fa4d4fd1700>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:13:43.106517 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-cb269b76-0bb5-4820-80da-fac51e28d81c tempest-VolumesSnapshotsTestJSON-1942860377 tempest-VolumesSnapshotsTestJSON-1942860377-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/829f80c5-8603-457e-a938-a78a05ca63ec" status: 200 len: 342 microversion: 2.1 time: 0.232614 Mar 31 18:13:43.107341 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 2/3] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Mar 31 18:13:42 2022] GET /compute/v2.1/os-volumes/829f80c5-8603-457e-a938-a78a05ca63ec => generated 342 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:13:43.115490 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-0a66403a-79c3-4bba-aeb0-b8e6623cc0b9 tempest-VolumesGetTestJSON-1687692381 tempest-VolumesGetTestJSON-1687692381-project] Calling method '.version_select at 0x7fa4d4fd18b0>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:13:43.313833 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-0a66403a-79c3-4bba-aeb0-b8e6623cc0b9 tempest-VolumesGetTestJSON-1687692381 tempest-VolumesGetTestJSON-1687692381-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/61379263-8418-497e-843f-a99bfd0621ad" status: 200 len: 353 microversion: 2.1 time: 0.205353 Mar 31 18:13:43.314552 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 3/4] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Mar 31 18:13:43 2022] GET /compute/v2.1/os-volumes/61379263-8418-497e-843f-a99bfd0621ad => generated 353 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:13:43.637897 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.virt.hardware [None req-be6fb64d-f661-4fce-930a-5b02ecc6e8c2 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Flavor limits 0:0:0 {{(pid=117539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 31 18:13:43.638475 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.virt.hardware [None req-be6fb64d-f661-4fce-930a-5b02ecc6e8c2 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Image limits 0:0:0 {{(pid=117539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 31 18:13:43.638860 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.virt.hardware [None req-be6fb64d-f661-4fce-930a-5b02ecc6e8c2 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Flavor pref 0:0:0 {{(pid=117539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 31 18:13:43.642795 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.virt.hardware [None req-be6fb64d-f661-4fce-930a-5b02ecc6e8c2 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Image pref 0:0:0 {{(pid=117539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 31 18:13:43.642795 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.virt.hardware [None req-be6fb64d-f661-4fce-930a-5b02ecc6e8c2 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 31 18:13:43.661726 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-be6fb64d-f661-4fce-930a-5b02ecc6e8c2 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:13:43.662176 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-be6fb64d-f661-4fce-930a-5b02ecc6e8c2 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:13:43.663179 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-be6fb64d-f661-4fce-930a-5b02ecc6e8c2 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:13:43.663609 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-be6fb64d-f661-4fce-930a-5b02ecc6e8c2 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:13:43.748486 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.quota [None req-be6fb64d-f661-4fce-930a-5b02ecc6e8c2 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Getting quotas for project 23366fa77e9049af8c183f6959cc158f. Resources: {'instances', 'ram', 'cores'} {{(pid=117539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 31 18:13:43.748486 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.quota [None req-be6fb64d-f661-4fce-930a-5b02ecc6e8c2 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Getting quotas for user ed1dacde91404110b259cfab7a37bb80 and project 23366fa77e9049af8c183f6959cc158f. Resources: {'instances', 'ram', 'cores'} {{(pid=117539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 31 18:13:43.748486 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-be6fb64d-f661-4fce-930a-5b02ecc6e8c2 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Going to run 1 instances... {{(pid=117539) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 31 18:13:43.750399 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-be6fb64d-f661-4fce-930a-5b02ecc6e8c2 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6241b999-6f6d-4076-88bc-345fa7386256',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 31 18:13:43.969628 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-be6fb64d-f661-4fce-930a-5b02ecc6e8c2 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.696995 Mar 31 18:13:43.970940 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 2/5] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Mar 31 18:13:42 2022] POST /compute/v2.1/servers => generated 380 bytes in 1699 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 31 18:13:43.981813 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-2450e734-8ad9-4e46-944d-ba64b2254953 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:13:43.982753 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-2450e734-8ad9-4e46-944d-ba64b2254953 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:13:44.129264 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-75cb85df-4f6a-4000-be96-0acfaa2536fb tempest-VolumesSnapshotsTestJSON-1942860377 tempest-VolumesSnapshotsTestJSON-1942860377-project] Calling method '.version_select at 0x7fa4d4678160>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:13:44.318474 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-2450e734-8ad9-4e46-944d-ba64b2254953 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1dacde91404110b259cfab7a37bb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23366fa77e9049af8c183f6959cc158f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:13:44.363539 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-2450e734-8ad9-4e46-944d-ba64b2254953 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] 10.222.0.58 "GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e" status: 200 len: 1214 microversion: 2.1 time: 0.386043 Mar 31 18:13:44.364129 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 4/6] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:13:43 2022] GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e => generated 1214 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:13:44.382487 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-ac83d98f-52ae-411e-877d-3fb2cd5790fe tempest-VolumesGetTestJSON-1687692381 tempest-VolumesGetTestJSON-1687692381-project] Calling method '.version_select at 0x7fa4d4fd1dc0>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:13:44.420990 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-75cb85df-4f6a-4000-be96-0acfaa2536fb tempest-VolumesSnapshotsTestJSON-1942860377 tempest-VolumesSnapshotsTestJSON-1942860377-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/829f80c5-8603-457e-a938-a78a05ca63ec" status: 200 len: 343 microversion: 2.1 time: 0.296654 Mar 31 18:13:44.422437 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 3/7] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Mar 31 18:13:44 2022] GET /compute/v2.1/os-volumes/829f80c5-8603-457e-a938-a78a05ca63ec => generated 343 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:13:44.435453 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-8564722b-0cfe-4f57-b795-79998ca2f7de tempest-VolumesSnapshotsTestJSON-1942860377 tempest-VolumesSnapshotsTestJSON-1942860377-project] Action: 'create', calling method: .version_select at 0x7fa4d4678820>, body: {"snapshot": {"volume_id": "829f80c5-8603-457e-a938-a78a05ca63ec", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1137240134"}} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:13:44.540550 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-ac83d98f-52ae-411e-877d-3fb2cd5790fe tempest-VolumesGetTestJSON-1687692381 tempest-VolumesGetTestJSON-1687692381-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/61379263-8418-497e-843f-a99bfd0621ad" status: 200 len: 354 microversion: 2.1 time: 0.170957 Mar 31 18:13:44.541122 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 5/8] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Mar 31 18:13:44 2022] GET /compute/v2.1/os-volumes/61379263-8418-497e-843f-a99bfd0621ad => generated 354 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:13:44.555806 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-9e618be3-a09f-4e93-babd-7fa48d605f72 tempest-VolumesGetTestJSON-1687692381 tempest-VolumesGetTestJSON-1687692381-project] Calling method '.version_select at 0x7fa4d4fad4c0>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:13:44.930267 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-9e618be3-a09f-4e93-babd-7fa48d605f72 tempest-VolumesGetTestJSON-1687692381 tempest-VolumesGetTestJSON-1687692381-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/61379263-8418-497e-843f-a99bfd0621ad" status: 200 len: 354 microversion: 2.1 time: 0.379422 Mar 31 18:13:44.931273 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 6/9] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Mar 31 18:13:44 2022] GET /compute/v2.1/os-volumes/61379263-8418-497e-843f-a99bfd0621ad => generated 354 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 31 18:13:44.943119 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-4a492788-2671-46da-8f29-ff5f35585822 tempest-VolumesGetTestJSON-1687692381 tempest-VolumesGetTestJSON-1687692381-project] Calling method '.version_select at 0x7fa4d4fadb80>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:13:45.439647 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-8564722b-0cfe-4f57-b795-79998ca2f7de tempest-VolumesSnapshotsTestJSON-1942860377 tempest-VolumesSnapshotsTestJSON-1942860377-project] 10.222.0.58 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 1.009581 Mar 31 18:13:45.441493 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 4/10] 10.222.0.58 () {60 vars in 1161 bytes} [Thu Mar 31 18:13:44 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 1012 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:13:45.451262 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-44736ef6-8b13-4fa2-b1da-3ceedcdcc408 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:13:45.452475 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-44736ef6-8b13-4fa2-b1da-3ceedcdcc408 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:13:45.711882 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-4a492788-2671-46da-8f29-ff5f35585822 tempest-VolumesGetTestJSON-1687692381 tempest-VolumesGetTestJSON-1687692381-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/61379263-8418-497e-843f-a99bfd0621ad" status: 202 len: 0 microversion: 2.1 time: 0.772919 Mar 31 18:13:45.716173 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 7/11] 10.222.0.58 () {58 vars in 1247 bytes} [Thu Mar 31 18:13:44 2022] DELETE /compute/v2.1/os-volumes/61379263-8418-497e-843f-a99bfd0621ad => generated 0 bytes in 778 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 31 18:13:45.721056 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-bba55316-bbf8-4cb3-aeb1-cb1290f33962 tempest-VolumesSnapshotsTestJSON-1942860377 tempest-VolumesSnapshotsTestJSON-1942860377-project] Calling method '.version_select at 0x7fa4d4fdfd30>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:13:45.847050 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-bba55316-bbf8-4cb3-aeb1-cb1290f33962 tempest-VolumesSnapshotsTestJSON-1942860377 tempest-VolumesSnapshotsTestJSON-1942860377-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/c7941548-51fe-4123-bac8-45f7eeed2106" status: 200 len: 287 microversion: 2.1 time: 0.128779 Mar 31 18:13:45.848290 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 8/12] 10.222.0.58 () {58 vars in 1250 bytes} [Thu Mar 31 18:13:45 2022] GET /compute/v2.1/os-snapshots/c7941548-51fe-4123-bac8-45f7eeed2106 => generated 287 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:13:45.854161 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-f136e37a-e362-4f80-b0aa-4d75e7f89435 tempest-VolumesGetTestJSON-1687692381 tempest-VolumesGetTestJSON-1687692381-project] Calling method '.version_select at 0x7fa4d4fada60>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:13:45.963169 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-f136e37a-e362-4f80-b0aa-4d75e7f89435 tempest-VolumesGetTestJSON-1687692381 tempest-VolumesGetTestJSON-1687692381-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/61379263-8418-497e-843f-a99bfd0621ad" status: 200 len: 353 microversion: 2.1 time: 0.113365 Mar 31 18:13:45.964262 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 9/13] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Mar 31 18:13:45 2022] GET /compute/v2.1/os-volumes/61379263-8418-497e-843f-a99bfd0621ad => generated 353 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:13:45.970603 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-68983bbf-9643-4f2c-8ed3-dea9ab15269f tempest-VolumesSnapshotsTestJSON-1942860377 tempest-VolumesSnapshotsTestJSON-1942860377-project] Calling method '.version_select at 0x7fa4d4fad430>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:13:46.016684 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-44736ef6-8b13-4fa2-b1da-3ceedcdcc408 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1dacde91404110b259cfab7a37bb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23366fa77e9049af8c183f6959cc158f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:13:46.056750 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-44736ef6-8b13-4fa2-b1da-3ceedcdcc408 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] 10.222.0.58 "GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e" status: 200 len: 1214 microversion: 2.1 time: 0.613909 Mar 31 18:13:46.066761 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 5/14] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:13:45 2022] GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e => generated 1214 bytes in 625 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:13:46.071695 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-68983bbf-9643-4f2c-8ed3-dea9ab15269f tempest-VolumesSnapshotsTestJSON-1942860377 tempest-VolumesSnapshotsTestJSON-1942860377-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.105204 Mar 31 18:13:46.072469 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 10/15] 10.222.0.58 () {58 vars in 1139 bytes} [Thu Mar 31 18:13:45 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:13:46.083881 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-00935c91-414a-4348-bed9-6d878679daf0 tempest-VolumesSnapshotsTestJSON-1942860377 tempest-VolumesSnapshotsTestJSON-1942860377-project] Calling method '.version_select at 0x7fa4d4678ee0>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:13:46.146978 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-00935c91-414a-4348-bed9-6d878679daf0 tempest-VolumesSnapshotsTestJSON-1942860377 tempest-VolumesSnapshotsTestJSON-1942860377-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/c7941548-51fe-4123-bac8-45f7eeed2106" status: 200 len: 287 microversion: 2.1 time: 0.065309 Mar 31 18:13:46.148323 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 6/16] 10.222.0.58 () {58 vars in 1250 bytes} [Thu Mar 31 18:13:46 2022] GET /compute/v2.1/os-snapshots/c7941548-51fe-4123-bac8-45f7eeed2106 => generated 287 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:13:46.978676 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-714f8498-5396-4dd0-b55f-1d56cad1859d tempest-VolumesGetTestJSON-1687692381 tempest-VolumesGetTestJSON-1687692381-project] Calling method '.version_select at 0x7fa4d4fadf70>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:13:47.076491 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-0177a94c-8214-442e-8300-25d5be92a15d tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:13:47.077230 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-0177a94c-8214-442e-8300-25d5be92a15d tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:13:47.108109 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-714f8498-5396-4dd0-b55f-1d56cad1859d tempest-VolumesGetTestJSON-1687692381 tempest-VolumesGetTestJSON-1687692381-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/61379263-8418-497e-843f-a99bfd0621ad" status: 200 len: 353 microversion: 2.1 time: 0.132116 Mar 31 18:13:47.108497 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0177a94c-8214-442e-8300-25d5be92a15d tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:13:47.108497 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0177a94c-8214-442e-8300-25d5be92a15d tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:13:47.108632 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 11/17] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Mar 31 18:13:46 2022] GET /compute/v2.1/os-volumes/61379263-8418-497e-843f-a99bfd0621ad => generated 353 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:13:47.114161 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0177a94c-8214-442e-8300-25d5be92a15d tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:13:47.114458 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0177a94c-8214-442e-8300-25d5be92a15d tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:13:47.159116 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-e4361c7c-966f-46f3-be16-f6551a5ba339 tempest-VolumesSnapshotsTestJSON-1942860377 tempest-VolumesSnapshotsTestJSON-1942860377-project] Calling method '.version_select at 0x7fa4d4fad9d0>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:13:47.200332 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-e4361c7c-966f-46f3-be16-f6551a5ba339 tempest-VolumesSnapshotsTestJSON-1942860377 tempest-VolumesSnapshotsTestJSON-1942860377-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/c7941548-51fe-4123-bac8-45f7eeed2106" status: 200 len: 287 microversion: 2.1 time: 0.044510 Mar 31 18:13:47.205344 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 12/18] 10.222.0.58 () {58 vars in 1250 bytes} [Thu Mar 31 18:13:47 2022] GET /compute/v2.1/os-snapshots/c7941548-51fe-4123-bac8-45f7eeed2106 => generated 287 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 31 18:13:47.346540 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-0177a94c-8214-442e-8300-25d5be92a15d tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1dacde91404110b259cfab7a37bb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23366fa77e9049af8c183f6959cc158f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:13:47.365167 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-0177a94c-8214-442e-8300-25d5be92a15d tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] 10.222.0.58 "GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e" status: 200 len: 1218 microversion: 2.1 time: 0.293312 Mar 31 18:13:47.366683 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 7/19] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:13:47 2022] GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e => generated 1218 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:13:48.119270 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-f9cbf66f-8446-43be-8c17-755b5ef8ed1b tempest-VolumesGetTestJSON-1687692381 tempest-VolumesGetTestJSON-1687692381-project] Calling method '.version_select at 0x7fa4d4fdf430>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:13:48.215681 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-0e4f0db5-cab5-45a0-9f70-51ff0b5b57ba tempest-VolumesSnapshotsTestJSON-1942860377 tempest-VolumesSnapshotsTestJSON-1942860377-project] Calling method '.version_select at 0x7fa4d4613f70>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:13:48.364853 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-f9cbf66f-8446-43be-8c17-755b5ef8ed1b tempest-VolumesGetTestJSON-1687692381 tempest-VolumesGetTestJSON-1687692381-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/61379263-8418-497e-843f-a99bfd0621ad" status: 200 len: 353 microversion: 2.1 time: 0.249586 Mar 31 18:13:48.365223 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 13/20] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Mar 31 18:13:48 2022] GET /compute/v2.1/os-volumes/61379263-8418-497e-843f-a99bfd0621ad => generated 353 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:13:48.373811 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-0e4f0db5-cab5-45a0-9f70-51ff0b5b57ba tempest-VolumesSnapshotsTestJSON-1942860377 tempest-VolumesSnapshotsTestJSON-1942860377-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/c7941548-51fe-4123-bac8-45f7eeed2106" status: 200 len: 287 microversion: 2.1 time: 0.165112 Mar 31 18:13:48.379467 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 8/21] 10.222.0.58 () {58 vars in 1250 bytes} [Thu Mar 31 18:13:48 2022] GET /compute/v2.1/os-snapshots/c7941548-51fe-4123-bac8-45f7eeed2106 => generated 287 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 31 18:13:48.385025 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-04abc4ba-f6fa-4385-b6d0-3eef75d9d6aa tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:13:48.386528 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-04abc4ba-f6fa-4385-b6d0-3eef75d9d6aa tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:13:48.396997 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-04abc4ba-f6fa-4385-b6d0-3eef75d9d6aa tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:13:48.399149 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-04abc4ba-f6fa-4385-b6d0-3eef75d9d6aa tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:13:48.400143 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-04abc4ba-f6fa-4385-b6d0-3eef75d9d6aa tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:13:48.405060 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-04abc4ba-f6fa-4385-b6d0-3eef75d9d6aa tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:13:48.732659 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-04abc4ba-f6fa-4385-b6d0-3eef75d9d6aa tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1dacde91404110b259cfab7a37bb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23366fa77e9049af8c183f6959cc158f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:13:48.750706 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-04abc4ba-f6fa-4385-b6d0-3eef75d9d6aa tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] 10.222.0.58 "GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e" status: 200 len: 1218 microversion: 2.1 time: 0.369362 Mar 31 18:13:48.751298 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 14/22] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:13:48 2022] GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e => generated 1218 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:13:49.378178 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-4f164ee7-b64a-4a9e-9e69-da558943d734 tempest-VolumesGetTestJSON-1687692381 tempest-VolumesGetTestJSON-1687692381-project] Calling method '.version_select at 0x7fa4d4621670>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:13:49.385278 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-fd3cfb66-69d2-4a25-967d-d22b2b8a8ca8 tempest-VolumesSnapshotsTestJSON-1942860377 tempest-VolumesSnapshotsTestJSON-1942860377-project] Calling method '.version_select at 0x7fa4d4f26e50>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:13:49.447124 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-fd3cfb66-69d2-4a25-967d-d22b2b8a8ca8 tempest-VolumesSnapshotsTestJSON-1942860377 tempest-VolumesSnapshotsTestJSON-1942860377-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/c7941548-51fe-4123-bac8-45f7eeed2106" status: 200 len: 287 microversion: 2.1 time: 0.065597 Mar 31 18:13:49.447961 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 15/23] 10.222.0.58 () {58 vars in 1250 bytes} [Thu Mar 31 18:13:49 2022] GET /compute/v2.1/os-snapshots/c7941548-51fe-4123-bac8-45f7eeed2106 => generated 287 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:13:49.483059 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-4f164ee7-b64a-4a9e-9e69-da558943d734 tempest-VolumesGetTestJSON-1687692381 tempest-VolumesGetTestJSON-1687692381-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/61379263-8418-497e-843f-a99bfd0621ad" status: 200 len: 353 microversion: 2.1 time: 0.108644 Mar 31 18:13:49.488050 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 9/24] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Mar 31 18:13:49 2022] GET /compute/v2.1/os-volumes/61379263-8418-497e-843f-a99bfd0621ad => generated 353 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:13:49.768576 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-e25dfd5d-6e5f-4db6-8367-995990a41126 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:13:49.769705 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-e25dfd5d-6e5f-4db6-8367-995990a41126 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:13:49.777459 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e25dfd5d-6e5f-4db6-8367-995990a41126 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:13:49.786739 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e25dfd5d-6e5f-4db6-8367-995990a41126 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:13:49.790995 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e25dfd5d-6e5f-4db6-8367-995990a41126 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:13:49.791485 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e25dfd5d-6e5f-4db6-8367-995990a41126 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:13:49.960328 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-e25dfd5d-6e5f-4db6-8367-995990a41126 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1dacde91404110b259cfab7a37bb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23366fa77e9049af8c183f6959cc158f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:13:49.986180 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-e25dfd5d-6e5f-4db6-8367-995990a41126 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] 10.222.0.58 "GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e" status: 200 len: 1218 microversion: 2.1 time: 0.221108 Mar 31 18:13:49.990970 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 16/25] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:13:49 2022] GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e => generated 1218 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:13:50.475513 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-401fcb62-86d1-49d0-a1e1-997616c76b02 tempest-VolumesSnapshotsTestJSON-1942860377 tempest-VolumesSnapshotsTestJSON-1942860377-project] Calling method '.version_select at 0x7fa4d4613ca0>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:13:50.495961 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-efa57c1c-98c7-4cc5-bcf7-8cecbfaa3ba7 tempest-VolumesGetTestJSON-1687692381 tempest-VolumesGetTestJSON-1687692381-project] Calling method '.version_select at 0x7fa4d4f34820>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:13:50.549156 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-401fcb62-86d1-49d0-a1e1-997616c76b02 tempest-VolumesSnapshotsTestJSON-1942860377 tempest-VolumesSnapshotsTestJSON-1942860377-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/c7941548-51fe-4123-bac8-45f7eeed2106" status: 200 len: 287 microversion: 2.1 time: 0.093581 Mar 31 18:13:50.549732 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 10/26] 10.222.0.58 () {58 vars in 1250 bytes} [Thu Mar 31 18:13:50 2022] GET /compute/v2.1/os-snapshots/c7941548-51fe-4123-bac8-45f7eeed2106 => generated 287 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:13:50.598124 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-efa57c1c-98c7-4cc5-bcf7-8cecbfaa3ba7 tempest-VolumesGetTestJSON-1687692381 tempest-VolumesGetTestJSON-1687692381-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/61379263-8418-497e-843f-a99bfd0621ad" status: 200 len: 353 microversion: 2.1 time: 0.106398 Mar 31 18:13:50.603537 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 17/27] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Mar 31 18:13:50 2022] GET /compute/v2.1/os-volumes/61379263-8418-497e-843f-a99bfd0621ad => generated 353 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:13:51.009848 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-79a4eee5-bbcd-4225-94f2-4b694802ebc9 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:13:51.010475 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-79a4eee5-bbcd-4225-94f2-4b694802ebc9 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:13:51.027777 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-79a4eee5-bbcd-4225-94f2-4b694802ebc9 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:13:51.028230 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-79a4eee5-bbcd-4225-94f2-4b694802ebc9 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:13:51.029626 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-79a4eee5-bbcd-4225-94f2-4b694802ebc9 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:13:51.032784 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-79a4eee5-bbcd-4225-94f2-4b694802ebc9 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:13:51.144730 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-79a4eee5-bbcd-4225-94f2-4b694802ebc9 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1dacde91404110b259cfab7a37bb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23366fa77e9049af8c183f6959cc158f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:13:51.153774 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-79a4eee5-bbcd-4225-94f2-4b694802ebc9 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] 10.222.0.58 "GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e" status: 200 len: 1218 microversion: 2.1 time: 0.150434 Mar 31 18:13:51.154718 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 11/28] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:13:51 2022] GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e => generated 1218 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:13:51.562522 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-db9c5829-109e-46ba-a2ec-c8440133d08b tempest-VolumesSnapshotsTestJSON-1942860377 tempest-VolumesSnapshotsTestJSON-1942860377-project] Calling method '.version_select at 0x7fa4d4693d30>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:13:51.595736 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-db9c5829-109e-46ba-a2ec-c8440133d08b tempest-VolumesSnapshotsTestJSON-1942860377 tempest-VolumesSnapshotsTestJSON-1942860377-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/c7941548-51fe-4123-bac8-45f7eeed2106" status: 200 len: 287 microversion: 2.1 time: 0.038434 Mar 31 18:13:51.600322 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 12/29] 10.222.0.58 () {58 vars in 1250 bytes} [Thu Mar 31 18:13:51 2022] GET /compute/v2.1/os-snapshots/c7941548-51fe-4123-bac8-45f7eeed2106 => generated 287 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:13:51.614283 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-e69c3291-f3dd-4a09-892c-d634bf2b30cb tempest-VolumesGetTestJSON-1687692381 tempest-VolumesGetTestJSON-1687692381-project] Calling method '.version_select at 0x7fa4d4613820>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:13:51.687367 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-e69c3291-f3dd-4a09-892c-d634bf2b30cb tempest-VolumesGetTestJSON-1687692381 tempest-VolumesGetTestJSON-1687692381-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/61379263-8418-497e-843f-a99bfd0621ad" status: 200 len: 353 microversion: 2.1 time: 0.074198 Mar 31 18:13:51.687367 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 13/30] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Mar 31 18:13:51 2022] GET /compute/v2.1/os-volumes/61379263-8418-497e-843f-a99bfd0621ad => generated 353 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:13:51.799847 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-0c6a5b2f-c53f-4904-90ba-57c690c9df20 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Action: 'create', calling method: .version_select at 0x7fa4d4f344c0>, body: {"keypair": {"name": "tempest-keypair-1288522538"}} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:13:51.847640 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.quota [None req-0c6a5b2f-c53f-4904-90ba-57c690c9df20 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Getting quotas for project eb7248f2c93342cd823f385c53a69d05. Resources: {'key_pairs'} {{(pid=117538) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 31 18:13:51.861061 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.quota [None req-0c6a5b2f-c53f-4904-90ba-57c690c9df20 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Getting quotas for user b1092332ac6040c597d28a4207c1ce86 and project eb7248f2c93342cd823f385c53a69d05. Resources: {'key_pairs'} {{(pid=117538) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 31 18:13:52.095386 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-fb4f880f-d846-4f95-b1df-fa827312d449 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-38646995", "imageRef": "6241b999-6f6d-4076-88bc-345fa7386256", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:13:52.197558 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.network.neutron [None req-fb4f880f-d846-4f95-b1df-fa827312d449 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] validate_networks() for [('fca50c83-3b91-4a03-8e1d-d873f4d904c1', None, None, None, None, None)] {{(pid=117539) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 31 18:13:52.208483 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.quota [None req-0c6a5b2f-c53f-4904-90ba-57c690c9df20 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Getting quotas for project eb7248f2c93342cd823f385c53a69d05. Resources: {'key_pairs'} {{(pid=117538) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 31 18:13:52.217067 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.quota [None req-0c6a5b2f-c53f-4904-90ba-57c690c9df20 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Getting quotas for user b1092332ac6040c597d28a4207c1ce86 and project eb7248f2c93342cd823f385c53a69d05. Resources: {'key_pairs'} {{(pid=117538) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 31 18:13:52.251135 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-0c6a5b2f-c53f-4904-90ba-57c690c9df20 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.698843 Mar 31 18:13:52.256086 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 18/31] 10.222.0.58 () {62 vars in 1198 bytes} [Thu Mar 31 18:13:51 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 704 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Mar 31 18:13:52.286474 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-c4eb24b9-092f-40bf-84de-f36495c22f01 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:13:52.287142 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-c4eb24b9-092f-40bf-84de-f36495c22f01 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:13:52.312328 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c4eb24b9-092f-40bf-84de-f36495c22f01 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:13:52.319443 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c4eb24b9-092f-40bf-84de-f36495c22f01 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:13:52.319443 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c4eb24b9-092f-40bf-84de-f36495c22f01 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:13:52.319443 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c4eb24b9-092f-40bf-84de-f36495c22f01 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:13:52.411033 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-c4eb24b9-092f-40bf-84de-f36495c22f01 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1dacde91404110b259cfab7a37bb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23366fa77e9049af8c183f6959cc158f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:13:52.420752 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-c4eb24b9-092f-40bf-84de-f36495c22f01 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] 10.222.0.58 "GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e" status: 200 len: 1210 microversion: 2.1 time: 0.149643 Mar 31 18:13:52.421705 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 19/32] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:13:52 2022] GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e => generated 1210 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:13:52.607920 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-fb719535-2bfa-4bef-adf6-044f1c714cea tempest-VolumesSnapshotsTestJSON-1942860377 tempest-VolumesSnapshotsTestJSON-1942860377-project] Calling method '.version_select at 0x7fa4d45f5ee0>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:13:52.666267 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-fb719535-2bfa-4bef-adf6-044f1c714cea tempest-VolumesSnapshotsTestJSON-1942860377 tempest-VolumesSnapshotsTestJSON-1942860377-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/c7941548-51fe-4123-bac8-45f7eeed2106" status: 200 len: 288 microversion: 2.1 time: 0.062260 Mar 31 18:13:52.667772 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 20/33] 10.222.0.58 () {58 vars in 1250 bytes} [Thu Mar 31 18:13:52 2022] GET /compute/v2.1/os-snapshots/c7941548-51fe-4123-bac8-45f7eeed2106 => generated 288 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:13:52.679735 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-89480411-2440-4170-9e00-6f65dfb7ed4d tempest-VolumesSnapshotsTestJSON-1942860377 tempest-VolumesSnapshotsTestJSON-1942860377-project] Calling method '.version_select at 0x7fa4d4e3df70>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:13:52.941849 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-89480411-2440-4170-9e00-6f65dfb7ed4d tempest-VolumesSnapshotsTestJSON-1942860377 tempest-VolumesSnapshotsTestJSON-1942860377-project] 10.222.0.58 "DELETE /compute/v2.1/os-snapshots/c7941548-51fe-4123-bac8-45f7eeed2106" status: 202 len: 0 microversion: 2.1 time: 0.267594 Mar 31 18:13:52.942485 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 21/34] 10.222.0.58 () {58 vars in 1253 bytes} [Thu Mar 31 18:13:52 2022] DELETE /compute/v2.1/os-snapshots/c7941548-51fe-4123-bac8-45f7eeed2106 => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 31 18:13:52.954159 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-1fd60125-a26f-4912-bfed-dc673905d29b tempest-VolumesGetTestJSON-1687692381 tempest-VolumesGetTestJSON-1687692381-project] Calling method '.version_select at 0x7fa4d460b280>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:13:52.971927 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.virt.hardware [None req-fb4f880f-d846-4f95-b1df-fa827312d449 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Flavor limits 0:0:0 {{(pid=117539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 31 18:13:52.972435 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.virt.hardware [None req-fb4f880f-d846-4f95-b1df-fa827312d449 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Image limits 0:0:0 {{(pid=117539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 31 18:13:52.979760 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.virt.hardware [None req-fb4f880f-d846-4f95-b1df-fa827312d449 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Flavor pref 0:0:0 {{(pid=117539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 31 18:13:52.979760 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.virt.hardware [None req-fb4f880f-d846-4f95-b1df-fa827312d449 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Image pref 0:0:0 {{(pid=117539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 31 18:13:52.979760 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.virt.hardware [None req-fb4f880f-d846-4f95-b1df-fa827312d449 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 31 18:13:52.991865 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-fb4f880f-d846-4f95-b1df-fa827312d449 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:13:52.992317 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-fb4f880f-d846-4f95-b1df-fa827312d449 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:13:52.993177 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-fb4f880f-d846-4f95-b1df-fa827312d449 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:13:53.003009 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-fb4f880f-d846-4f95-b1df-fa827312d449 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:13:53.047866 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.wsgi [None req-1fd60125-a26f-4912-bfed-dc673905d29b tempest-VolumesGetTestJSON-1687692381 tempest-VolumesGetTestJSON-1687692381-project] HTTP exception thrown: Volume 61379263-8418-497e-843f-a99bfd0621ad could not be found. Mar 31 18:13:53.048928 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-1fd60125-a26f-4912-bfed-dc673905d29b tempest-VolumesGetTestJSON-1687692381 tempest-VolumesGetTestJSON-1687692381-project] Returning 404 to user: Volume 61379263-8418-497e-843f-a99bfd0621ad could not be found. {{(pid=117538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:13:53.050329 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-1fd60125-a26f-4912-bfed-dc673905d29b tempest-VolumesGetTestJSON-1687692381 tempest-VolumesGetTestJSON-1687692381-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/61379263-8418-497e-843f-a99bfd0621ad" status: 404 len: 109 microversion: 2.1 time: 0.106953 Mar 31 18:13:53.056250 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 22/35] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Mar 31 18:13:52 2022] GET /compute/v2.1/os-volumes/61379263-8418-497e-843f-a99bfd0621ad => generated 109 bytes in 113 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 31 18:13:53.078830 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-c0fa4e9f-26ae-4bbb-b15e-b52f7c24fb93 tempest-VolumesSnapshotsTestJSON-1942860377 tempest-VolumesSnapshotsTestJSON-1942860377-project] Calling method '.version_select at 0x7fa4d45f5b80>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:13:53.080313 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.quota [None req-fb4f880f-d846-4f95-b1df-fa827312d449 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Getting quotas for project 6fc2eb72902a441ca6a6fa9350ce75f8. Resources: {'instances', 'ram', 'cores'} {{(pid=117539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 31 18:13:53.091941 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.quota [None req-fb4f880f-d846-4f95-b1df-fa827312d449 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Getting quotas for user d6a93e87d6894cfd9b7948274f1d7b70 and project 6fc2eb72902a441ca6a6fa9350ce75f8. Resources: {'instances', 'ram', 'cores'} {{(pid=117539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 31 18:13:53.122582 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-fb4f880f-d846-4f95-b1df-fa827312d449 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Going to run 1 instances... {{(pid=117539) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 31 18:13:53.124790 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-fb4f880f-d846-4f95-b1df-fa827312d449 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 779c13cd-7a7a-47b4-b488-0d1e365c3dc4] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6241b999-6f6d-4076-88bc-345fa7386256',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 31 18:13:53.124942 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-c0fa4e9f-26ae-4bbb-b15e-b52f7c24fb93 tempest-VolumesSnapshotsTestJSON-1942860377 tempest-VolumesSnapshotsTestJSON-1942860377-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/c7941548-51fe-4123-bac8-45f7eeed2106" status: 200 len: 287 microversion: 2.1 time: 0.065931 Mar 31 18:13:53.125442 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 23/36] 10.222.0.58 () {58 vars in 1250 bytes} [Thu Mar 31 18:13:53 2022] GET /compute/v2.1/os-snapshots/c7941548-51fe-4123-bac8-45f7eeed2106 => generated 287 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:13:53.326892 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-fb4f880f-d846-4f95-b1df-fa827312d449 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.644432 Mar 31 18:13:53.338047 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-26013e0c-01f8-4863-b18c-8183fab4a004 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:13:53.348448 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 14/37] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Mar 31 18:13:51 2022] POST /compute/v2.1/servers => generated 383 bytes in 1666 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 31 18:13:53.354810 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-26013e0c-01f8-4863-b18c-8183fab4a004 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 779c13cd-7a7a-47b4-b488-0d1e365c3dc4] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:13:53.452369 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-665572d6-f2f5-40ce-9137-0e3011e66bfb tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:13:53.453249 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-665572d6-f2f5-40ce-9137-0e3011e66bfb tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:13:53.468914 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-665572d6-f2f5-40ce-9137-0e3011e66bfb tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:13:53.469554 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-665572d6-f2f5-40ce-9137-0e3011e66bfb tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:13:53.470925 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-665572d6-f2f5-40ce-9137-0e3011e66bfb tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:13:53.471526 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-665572d6-f2f5-40ce-9137-0e3011e66bfb tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:13:53.606157 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-665572d6-f2f5-40ce-9137-0e3011e66bfb tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1dacde91404110b259cfab7a37bb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23366fa77e9049af8c183f6959cc158f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:13:53.621244 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-665572d6-f2f5-40ce-9137-0e3011e66bfb tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] 10.222.0.58 "GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e" status: 200 len: 1266 microversion: 2.1 time: 0.172845 Mar 31 18:13:53.641444 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 15/38] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:13:53 2022] GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e => generated 1266 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:13:53.942513 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-26013e0c-01f8-4863-b18c-8183fab4a004 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:13:53.950911 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-26013e0c-01f8-4863-b18c-8183fab4a004 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4" status: 200 len: 1220 microversion: 2.1 time: 0.616528 Mar 31 18:13:53.951498 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 24/39] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:13:53 2022] GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4 => generated 1220 bytes in 618 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:13:54.138385 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-79d8551f-27ff-4198-b402-a2b308c9d79b tempest-VolumesSnapshotsTestJSON-1942860377 tempest-VolumesSnapshotsTestJSON-1942860377-project] Calling method '.version_select at 0x7fa4d4621700>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:13:54.189269 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.wsgi [None req-79d8551f-27ff-4198-b402-a2b308c9d79b tempest-VolumesSnapshotsTestJSON-1942860377 tempest-VolumesSnapshotsTestJSON-1942860377-project] HTTP exception thrown: Snapshot c7941548-51fe-4123-bac8-45f7eeed2106 could not be found. Mar 31 18:13:54.190416 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-79d8551f-27ff-4198-b402-a2b308c9d79b tempest-VolumesSnapshotsTestJSON-1942860377 tempest-VolumesSnapshotsTestJSON-1942860377-project] Returning 404 to user: Snapshot c7941548-51fe-4123-bac8-45f7eeed2106 could not be found. {{(pid=117539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:13:54.191610 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-79d8551f-27ff-4198-b402-a2b308c9d79b tempest-VolumesSnapshotsTestJSON-1942860377 tempest-VolumesSnapshotsTestJSON-1942860377-project] 10.222.0.58 "GET /compute/v2.1/os-snapshots/c7941548-51fe-4123-bac8-45f7eeed2106" status: 404 len: 111 microversion: 2.1 time: 0.059193 Mar 31 18:13:54.192403 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 16/40] 10.222.0.58 () {58 vars in 1250 bytes} [Thu Mar 31 18:13:54 2022] GET /compute/v2.1/os-snapshots/c7941548-51fe-4123-bac8-45f7eeed2106 => generated 111 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 31 18:13:54.202025 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-1e48562d-b9e8-469f-b5bc-df5e43f8d626 tempest-VolumesSnapshotsTestJSON-1942860377 tempest-VolumesSnapshotsTestJSON-1942860377-project] Calling method '.version_select at 0x7fa4d45f5430>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:13:54.481324 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-1e48562d-b9e8-469f-b5bc-df5e43f8d626 tempest-VolumesSnapshotsTestJSON-1942860377 tempest-VolumesSnapshotsTestJSON-1942860377-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/829f80c5-8603-457e-a938-a78a05ca63ec" status: 202 len: 0 microversion: 2.1 time: 0.284263 Mar 31 18:13:54.483224 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 25/41] 10.222.0.58 () {58 vars in 1247 bytes} [Thu Mar 31 18:13:54 2022] DELETE /compute/v2.1/os-volumes/829f80c5-8603-457e-a938-a78a05ca63ec => generated 0 bytes in 287 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 31 18:13:54.496829 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-c3557d56-8816-410b-b8ee-b8b6339e0d25 tempest-VolumesSnapshotsTestJSON-1942860377 tempest-VolumesSnapshotsTestJSON-1942860377-project] Calling method '.version_select at 0x7fa4d4fa0b80>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:13:54.501126 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-3c921b6f-d23d-4075-96ca-6ecf2cd63da4 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-383547739", "imageRef": "6241b999-6f6d-4076-88bc-345fa7386256", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:13:54.634536 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-c3557d56-8816-410b-b8ee-b8b6339e0d25 tempest-VolumesSnapshotsTestJSON-1942860377 tempest-VolumesSnapshotsTestJSON-1942860377-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/829f80c5-8603-457e-a938-a78a05ca63ec" status: 200 len: 342 microversion: 2.1 time: 0.142121 Mar 31 18:13:54.635623 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 26/42] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Mar 31 18:13:54 2022] GET /compute/v2.1/os-volumes/829f80c5-8603-457e-a938-a78a05ca63ec => generated 342 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:13:54.646426 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.network.neutron [None req-3c921b6f-d23d-4075-96ca-6ecf2cd63da4 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] validate_networks() for [('fca50c83-3b91-4a03-8e1d-d873f4d904c1', None, None, None, None, None)] {{(pid=117539) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 31 18:13:54.656970 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-24a158ad-d56b-48c6-8bb0-d0cf53c3adba tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:13:54.658354 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-24a158ad-d56b-48c6-8bb0-d0cf53c3adba tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:13:54.692948 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-24a158ad-d56b-48c6-8bb0-d0cf53c3adba tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:13:54.694094 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-24a158ad-d56b-48c6-8bb0-d0cf53c3adba tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:13:54.695358 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-24a158ad-d56b-48c6-8bb0-d0cf53c3adba tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:13:54.697044 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-24a158ad-d56b-48c6-8bb0-d0cf53c3adba tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:13:54.986496 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-24a158ad-d56b-48c6-8bb0-d0cf53c3adba tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1dacde91404110b259cfab7a37bb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23366fa77e9049af8c183f6959cc158f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:13:54.997074 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-24a158ad-d56b-48c6-8bb0-d0cf53c3adba tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] 10.222.0.58 "GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e" status: 200 len: 1272 microversion: 2.1 time: 0.357394 Mar 31 18:13:55.031505 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 27/43] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:13:54 2022] GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e => generated 1272 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:13:55.647293 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-40002514-555e-48bb-a493-b820a3ca4d5e tempest-VolumesSnapshotsTestJSON-1942860377 tempest-VolumesSnapshotsTestJSON-1942860377-project] Calling method '.version_select at 0x7fa4d460b4c0>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:13:55.712016 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.wsgi [None req-40002514-555e-48bb-a493-b820a3ca4d5e tempest-VolumesSnapshotsTestJSON-1942860377 tempest-VolumesSnapshotsTestJSON-1942860377-project] HTTP exception thrown: Volume 829f80c5-8603-457e-a938-a78a05ca63ec could not be found. Mar 31 18:13:55.712016 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-40002514-555e-48bb-a493-b820a3ca4d5e tempest-VolumesSnapshotsTestJSON-1942860377 tempest-VolumesSnapshotsTestJSON-1942860377-project] Returning 404 to user: Volume 829f80c5-8603-457e-a938-a78a05ca63ec could not be found. {{(pid=117538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:13:55.712016 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-40002514-555e-48bb-a493-b820a3ca4d5e tempest-VolumesSnapshotsTestJSON-1942860377 tempest-VolumesSnapshotsTestJSON-1942860377-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/829f80c5-8603-457e-a938-a78a05ca63ec" status: 404 len: 109 microversion: 2.1 time: 0.068260 Mar 31 18:13:55.712016 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 28/44] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Mar 31 18:13:55 2022] GET /compute/v2.1/os-volumes/829f80c5-8603-457e-a938-a78a05ca63ec => generated 109 bytes in 69 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 31 18:13:55.726876 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-21dfb6f4-d3bd-40de-bacd-c60faf6db382 tempest-VolumesSnapshotsTestJSON-1942860377 tempest-VolumesSnapshotsTestJSON-1942860377-project] Calling method '.version_select at 0x7fa4d4624e50>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:13:56.015405 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.wsgi [None req-21dfb6f4-d3bd-40de-bacd-c60faf6db382 tempest-VolumesSnapshotsTestJSON-1942860377 tempest-VolumesSnapshotsTestJSON-1942860377-project] HTTP exception thrown: Volume 829f80c5-8603-457e-a938-a78a05ca63ec could not be found. Mar 31 18:13:56.016011 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-21dfb6f4-d3bd-40de-bacd-c60faf6db382 tempest-VolumesSnapshotsTestJSON-1942860377 tempest-VolumesSnapshotsTestJSON-1942860377-project] Returning 404 to user: Volume 829f80c5-8603-457e-a938-a78a05ca63ec could not be found. {{(pid=117538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:13:56.016817 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-21dfb6f4-d3bd-40de-bacd-c60faf6db382 tempest-VolumesSnapshotsTestJSON-1942860377 tempest-VolumesSnapshotsTestJSON-1942860377-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/829f80c5-8603-457e-a938-a78a05ca63ec" status: 404 len: 109 microversion: 2.1 time: 0.294135 Mar 31 18:13:56.020822 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 29/45] 10.222.0.58 () {58 vars in 1247 bytes} [Thu Mar 31 18:13:55 2022] DELETE /compute/v2.1/os-volumes/829f80c5-8603-457e-a938-a78a05ca63ec => generated 109 bytes in 298 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 31 18:13:56.027227 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-2b8f98f8-08f5-4377-a151-009d59ad630a tempest-VolumesSnapshotsTestJSON-1942860377 tempest-VolumesSnapshotsTestJSON-1942860377-project] Calling method '.version_select at 0x7fa4d4e3d8b0>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:13:56.074066 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.wsgi [None req-2b8f98f8-08f5-4377-a151-009d59ad630a tempest-VolumesSnapshotsTestJSON-1942860377 tempest-VolumesSnapshotsTestJSON-1942860377-project] HTTP exception thrown: Volume 829f80c5-8603-457e-a938-a78a05ca63ec could not be found. Mar 31 18:13:56.074693 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-2b8f98f8-08f5-4377-a151-009d59ad630a tempest-VolumesSnapshotsTestJSON-1942860377 tempest-VolumesSnapshotsTestJSON-1942860377-project] Returning 404 to user: Volume 829f80c5-8603-457e-a938-a78a05ca63ec could not be found. {{(pid=117538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:13:56.076254 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-2b8f98f8-08f5-4377-a151-009d59ad630a tempest-VolumesSnapshotsTestJSON-1942860377 tempest-VolumesSnapshotsTestJSON-1942860377-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/829f80c5-8603-457e-a938-a78a05ca63ec" status: 404 len: 109 microversion: 2.1 time: 0.053143 Mar 31 18:13:56.080579 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 30/46] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Mar 31 18:13:56 2022] GET /compute/v2.1/os-volumes/829f80c5-8603-457e-a938-a78a05ca63ec => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 31 18:13:56.090027 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-f0a4015d-62e0-48fe-a238-4a580c9c0f14 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:13:56.091300 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-f0a4015d-62e0-48fe-a238-4a580c9c0f14 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:13:56.126825 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f0a4015d-62e0-48fe-a238-4a580c9c0f14 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:13:56.127462 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f0a4015d-62e0-48fe-a238-4a580c9c0f14 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:13:56.128341 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f0a4015d-62e0-48fe-a238-4a580c9c0f14 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:13:56.128791 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f0a4015d-62e0-48fe-a238-4a580c9c0f14 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:13:56.253394 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-f0a4015d-62e0-48fe-a238-4a580c9c0f14 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1dacde91404110b259cfab7a37bb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23366fa77e9049af8c183f6959cc158f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:13:56.264561 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-f0a4015d-62e0-48fe-a238-4a580c9c0f14 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] 10.222.0.58 "GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e" status: 200 len: 1272 microversion: 2.1 time: 0.182783 Mar 31 18:13:56.278662 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 31/47] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:13:56 2022] GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e => generated 1272 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:13:56.941450 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.virt.hardware [None req-3c921b6f-d23d-4075-96ca-6ecf2cd63da4 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Flavor limits 0:0:0 {{(pid=117539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 31 18:13:56.942538 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.virt.hardware [None req-3c921b6f-d23d-4075-96ca-6ecf2cd63da4 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Image limits 0:0:0 {{(pid=117539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 31 18:13:56.943195 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.virt.hardware [None req-3c921b6f-d23d-4075-96ca-6ecf2cd63da4 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Flavor pref 0:0:0 {{(pid=117539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 31 18:13:56.943820 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.virt.hardware [None req-3c921b6f-d23d-4075-96ca-6ecf2cd63da4 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Image pref 0:0:0 {{(pid=117539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 31 18:13:56.944381 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.virt.hardware [None req-3c921b6f-d23d-4075-96ca-6ecf2cd63da4 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 31 18:13:56.966185 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3c921b6f-d23d-4075-96ca-6ecf2cd63da4 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:13:56.971013 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3c921b6f-d23d-4075-96ca-6ecf2cd63da4 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:13:56.972316 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3c921b6f-d23d-4075-96ca-6ecf2cd63da4 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:13:56.973497 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3c921b6f-d23d-4075-96ca-6ecf2cd63da4 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:13:57.290073 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-705bdee2-08c3-4922-983a-54b9ffc90953 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:13:57.290724 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-705bdee2-08c3-4922-983a-54b9ffc90953 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:13:57.323941 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-705bdee2-08c3-4922-983a-54b9ffc90953 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:13:57.324400 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-705bdee2-08c3-4922-983a-54b9ffc90953 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:13:57.325204 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-705bdee2-08c3-4922-983a-54b9ffc90953 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:13:57.325641 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-705bdee2-08c3-4922-983a-54b9ffc90953 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:13:57.462040 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.quota [None req-3c921b6f-d23d-4075-96ca-6ecf2cd63da4 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Getting quotas for project 6fc2eb72902a441ca6a6fa9350ce75f8. Resources: {'instances', 'ram', 'cores'} {{(pid=117539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 31 18:13:57.480479 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.quota [None req-3c921b6f-d23d-4075-96ca-6ecf2cd63da4 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Getting quotas for user d6a93e87d6894cfd9b7948274f1d7b70 and project 6fc2eb72902a441ca6a6fa9350ce75f8. Resources: {'instances', 'ram', 'cores'} {{(pid=117539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 31 18:13:57.529596 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-3c921b6f-d23d-4075-96ca-6ecf2cd63da4 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Going to run 1 instances... {{(pid=117539) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 31 18:13:57.539303 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-3c921b6f-d23d-4075-96ca-6ecf2cd63da4 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6241b999-6f6d-4076-88bc-345fa7386256',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 31 18:13:57.778737 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-705bdee2-08c3-4922-983a-54b9ffc90953 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1dacde91404110b259cfab7a37bb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23366fa77e9049af8c183f6959cc158f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:13:57.792665 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-705bdee2-08c3-4922-983a-54b9ffc90953 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] 10.222.0.58 "GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e" status: 200 len: 1314 microversion: 2.1 time: 0.511884 Mar 31 18:13:57.797159 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 32/48] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:13:57 2022] GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e => generated 1314 bytes in 517 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:13:57.821650 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-3c921b6f-d23d-4075-96ca-6ecf2cd63da4 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.329537 Mar 31 18:13:57.825556 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 17/49] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Mar 31 18:13:54 2022] POST /compute/v2.1/servers => generated 383 bytes in 3334 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 31 18:13:57.835981 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-02c245a6-77f4-409a-93b9-9e31dc8040fc tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:13:57.836912 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-02c245a6-77f4-409a-93b9-9e31dc8040fc tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:13:58.002884 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-02c245a6-77f4-409a-93b9-9e31dc8040fc tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:13:58.013057 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-02c245a6-77f4-409a-93b9-9e31dc8040fc tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1221 microversion: 2.1 time: 0.178893 Mar 31 18:13:58.015884 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 33/50] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:13:57 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1221 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:13:58.816037 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-70562568-3b33-40ba-8d3b-5788b27c176f tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:13:58.817300 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-70562568-3b33-40ba-8d3b-5788b27c176f tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:13:58.839489 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-70562568-3b33-40ba-8d3b-5788b27c176f tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:13:58.841450 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-70562568-3b33-40ba-8d3b-5788b27c176f tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:13:58.857020 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-70562568-3b33-40ba-8d3b-5788b27c176f tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:13:58.857596 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-70562568-3b33-40ba-8d3b-5788b27c176f tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:13:59.031136 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-32de00d0-8a89-45a5-b05b-3d0922feba4c tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:13:59.031960 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-32de00d0-8a89-45a5-b05b-3d0922feba4c tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:13:59.155601 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-32de00d0-8a89-45a5-b05b-3d0922feba4c tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:13:59.164787 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-32de00d0-8a89-45a5-b05b-3d0922feba4c tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1221 microversion: 2.1 time: 0.135726 Mar 31 18:13:59.170115 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 34/51] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:13:59 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1221 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:00.007137 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-70562568-3b33-40ba-8d3b-5788b27c176f tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1dacde91404110b259cfab7a37bb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23366fa77e9049af8c183f6959cc158f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:00.007137 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-70562568-3b33-40ba-8d3b-5788b27c176f tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] 10.222.0.58 "GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e" status: 200 len: 1314 microversion: 2.1 time: 1.184696 Mar 31 18:14:00.007137 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 18/52] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:13:58 2022] GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e => generated 1314 bytes in 1186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:00.207698 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-16200372-3b4b-469f-bded-196002517d33 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:00.207698 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-16200372-3b4b-469f-bded-196002517d33 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:00.226997 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-16200372-3b4b-469f-bded-196002517d33 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:00.227489 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-16200372-3b4b-469f-bded-196002517d33 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:00.228291 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-16200372-3b4b-469f-bded-196002517d33 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:00.228727 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-16200372-3b4b-469f-bded-196002517d33 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:00.324790 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-f8a9a9a6-2dae-4367-ac18-53edf40dc3fb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1992672889", "imageRef": "6241b999-6f6d-4076-88bc-345fa7386256", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b654ebd8-4c33-443d-bee5-4bafdafcd132"}], "security_groups": [{"name": "tempest-securitygroup--1453235839"}], "key_name": "tempest-keypair-1288522538", "user_data": "}} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:14:00.492090 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-16200372-3b4b-469f-bded-196002517d33 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:00.505683 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-16200372-3b4b-469f-bded-196002517d33 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1225 microversion: 2.1 time: 0.303190 Mar 31 18:14:00.511284 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 35/53] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:00 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1225 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:00.857948 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.network.neutron [None req-f8a9a9a6-2dae-4367-ac18-53edf40dc3fb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] validate_networks() for [('b654ebd8-4c33-443d-bee5-4bafdafcd132', None, None, None, None, None)] {{(pid=117539) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 31 18:14:01.015528 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-f40d0652-b080-418a-8fc7-0c918a2a5783 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:01.016122 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-f40d0652-b080-418a-8fc7-0c918a2a5783 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:01.045072 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f40d0652-b080-418a-8fc7-0c918a2a5783 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:01.046073 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f40d0652-b080-418a-8fc7-0c918a2a5783 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:01.047470 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f40d0652-b080-418a-8fc7-0c918a2a5783 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:01.048169 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f40d0652-b080-418a-8fc7-0c918a2a5783 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:01.363206 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-f40d0652-b080-418a-8fc7-0c918a2a5783 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1dacde91404110b259cfab7a37bb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23366fa77e9049af8c183f6959cc158f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:01.375109 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-f40d0652-b080-418a-8fc7-0c918a2a5783 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] 10.222.0.58 "GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e" status: 200 len: 1314 microversion: 2.1 time: 0.365290 Mar 31 18:14:01.375969 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 36/54] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:01 2022] GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e => generated 1314 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:14:01.529261 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-0462da5b-0400-4d82-8be4-5cfad6ea97d9 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:01.529886 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-0462da5b-0400-4d82-8be4-5cfad6ea97d9 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:01.541565 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-0462da5b-0400-4d82-8be4-5cfad6ea97d9 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:01.542016 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-0462da5b-0400-4d82-8be4-5cfad6ea97d9 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:01.548491 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-0462da5b-0400-4d82-8be4-5cfad6ea97d9 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:01.548491 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-0462da5b-0400-4d82-8be4-5cfad6ea97d9 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:01.876516 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-0462da5b-0400-4d82-8be4-5cfad6ea97d9 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:01.890356 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-0462da5b-0400-4d82-8be4-5cfad6ea97d9 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1217 microversion: 2.1 time: 0.365108 Mar 31 18:14:01.911119 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 37/55] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:01 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1217 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:14:02.778330 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-5c737af0-82c6-48c5-a8f4-9859a8295a4b tempest-VolumesNegativeTest-321645948 tempest-VolumesNegativeTest-321645948-project] Action: 'create', calling method: .version_select at 0x7fa4d4624790>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1066212399", "metadata": {"Type": "work"}}} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:14:02.780513 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-5c737af0-82c6-48c5-a8f4-9859a8295a4b tempest-VolumesNegativeTest-321645948 tempest-VolumesNegativeTest-321645948-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:14:02.781524 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-5c737af0-82c6-48c5-a8f4-9859a8295a4b tempest-VolumesNegativeTest-321645948 tempest-VolumesNegativeTest-321645948-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.869055 Mar 31 18:14:02.782258 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 38/56] 10.222.0.58 () {60 vars in 1155 bytes} [Thu Mar 31 18:14:01 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 870 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 31 18:14:02.803628 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-4c0e9b20-2960-4299-ae5e-07fefb4ee68d tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:02.808787 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-4c0e9b20-2960-4299-ae5e-07fefb4ee68d tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:02.827019 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4c0e9b20-2960-4299-ae5e-07fefb4ee68d tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:02.834595 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4c0e9b20-2960-4299-ae5e-07fefb4ee68d tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:02.835841 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4c0e9b20-2960-4299-ae5e-07fefb4ee68d tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:02.837526 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4c0e9b20-2960-4299-ae5e-07fefb4ee68d tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:02.841923 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.virt.hardware [None req-f8a9a9a6-2dae-4367-ac18-53edf40dc3fb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Flavor limits 0:0:0 {{(pid=117539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 31 18:14:02.843082 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.virt.hardware [None req-f8a9a9a6-2dae-4367-ac18-53edf40dc3fb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Image limits 0:0:0 {{(pid=117539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 31 18:14:02.843686 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.virt.hardware [None req-f8a9a9a6-2dae-4367-ac18-53edf40dc3fb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Flavor pref 0:0:0 {{(pid=117539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 31 18:14:02.844156 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.virt.hardware [None req-f8a9a9a6-2dae-4367-ac18-53edf40dc3fb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Image pref 0:0:0 {{(pid=117539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 31 18:14:02.844634 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.virt.hardware [None req-f8a9a9a6-2dae-4367-ac18-53edf40dc3fb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 31 18:14:02.864228 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-f8a9a9a6-2dae-4367-ac18-53edf40dc3fb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:02.868228 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-f8a9a9a6-2dae-4367-ac18-53edf40dc3fb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:02.869276 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-f8a9a9a6-2dae-4367-ac18-53edf40dc3fb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:02.869729 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-f8a9a9a6-2dae-4367-ac18-53edf40dc3fb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:02.918511 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.quota [None req-f8a9a9a6-2dae-4367-ac18-53edf40dc3fb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Getting quotas for project eb7248f2c93342cd823f385c53a69d05. Resources: {'instances', 'ram', 'cores'} {{(pid=117539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 31 18:14:02.929425 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.quota [None req-f8a9a9a6-2dae-4367-ac18-53edf40dc3fb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Getting quotas for user b1092332ac6040c597d28a4207c1ce86 and project eb7248f2c93342cd823f385c53a69d05. Resources: {'instances', 'ram', 'cores'} {{(pid=117539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 31 18:14:02.966557 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-f8a9a9a6-2dae-4367-ac18-53edf40dc3fb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Going to run 1 instances... {{(pid=117539) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 31 18:14:02.969327 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-f8a9a9a6-2dae-4367-ac18-53edf40dc3fb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6241b999-6f6d-4076-88bc-345fa7386256',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 31 18:14:03.199231 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-f8a9a9a6-2dae-4367-ac18-53edf40dc3fb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.877152 Mar 31 18:14:03.200488 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 19/57] 10.222.0.58 () {62 vars in 1187 bytes} [Thu Mar 31 18:14:00 2022] POST /compute/v2.1/servers => generated 402 bytes in 2881 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Mar 31 18:14:03.505220 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-4c0e9b20-2960-4299-ae5e-07fefb4ee68d tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1dacde91404110b259cfab7a37bb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23366fa77e9049af8c183f6959cc158f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:03.538766 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-4c0e9b20-2960-4299-ae5e-07fefb4ee68d tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] 10.222.0.58 "GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e" status: 200 len: 1314 microversion: 2.1 time: 0.746737 Mar 31 18:14:03.544187 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 39/58] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:02 2022] GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e => generated 1314 bytes in 761 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:03.593224 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-181cbbc7-6135-407e-bdcb-bef8b9536be1 tempest-VolumesNegativeTest-321645948 tempest-VolumesNegativeTest-321645948-project] Action: 'create', calling method: .version_select at 0x7fa4d4624a60>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-885748071", "metadata": {"Type": "work"}}} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:14:03.593224 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-181cbbc7-6135-407e-bdcb-bef8b9536be1 tempest-VolumesNegativeTest-321645948 tempest-VolumesNegativeTest-321645948-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:14:03.593224 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-181cbbc7-6135-407e-bdcb-bef8b9536be1 tempest-VolumesNegativeTest-321645948 tempest-VolumesNegativeTest-321645948-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.032830 Mar 31 18:14:03.593827 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [req-6b63b741-8e6b-48a3-9da0-3f81ea55b70e req-99a95743-4c0b-432a-a238-b885bc4a8927 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4a8079a-7824-4201-889b-a14d70024f7e", "tag": "b41ca13e-f9fc-4896-a18b-4d8b90a0ef6b"}]} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:14:03.611517 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 40/59] 10.222.0.58 () {60 vars in 1155 bytes} [Thu Mar 31 18:14:03 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 38 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 31 18:14:03.624684 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-6b63b741-8e6b-48a3-9da0-3f81ea55b70e req-99a95743-4c0b-432a-a238-b885bc4a8927 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:03.625289 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-6b63b741-8e6b-48a3-9da0-3f81ea55b70e req-99a95743-4c0b-432a-a238-b885bc4a8927 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:03.629917 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-af3d3867-04db-4437-8093-42a961d3003b tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:03.630590 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-af3d3867-04db-4437-8093-42a961d3003b tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:03.653364 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-af3d3867-04db-4437-8093-42a961d3003b tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:03.659153 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-af3d3867-04db-4437-8093-42a961d3003b tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:03.659153 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-af3d3867-04db-4437-8093-42a961d3003b tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:03.659153 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-af3d3867-04db-4437-8093-42a961d3003b tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:03.677185 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.compute.server_external_events [req-6b63b741-8e6b-48a3-9da0-3f81ea55b70e req-99a95743-4c0b-432a-a238-b885bc4a8927 service nova] Creating event network-changed:b41ca13e-f9fc-4896-a18b-4d8b90a0ef6b for instance b4a8079a-7824-4201-889b-a14d70024f7e on hv-cinder-maste Mar 31 18:14:03.677719 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-6b63b741-8e6b-48a3-9da0-3f81ea55b70e req-99a95743-4c0b-432a-a238-b885bc4a8927 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117539) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 31 18:14:03.679122 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-747b141e-b5cc-404d-82b0-9df9711e0161 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:03.683249 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-747b141e-b5cc-404d-82b0-9df9711e0161 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:03.686381 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-747b141e-b5cc-404d-82b0-9df9711e0161 None None] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:03.686884 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-747b141e-b5cc-404d-82b0-9df9711e0161 None None] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:03.720286 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.compute.rpcapi [None req-747b141e-b5cc-404d-82b0-9df9711e0161 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Mar 31 18:14:03.721466 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-747b141e-b5cc-404d-82b0-9df9711e0161 None None] Releasing lock "compute-rpcapi-router" {{(pid=117539) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 31 18:14:03.773245 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-747b141e-b5cc-404d-82b0-9df9711e0161 None None] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.571342 Mar 31 18:14:03.774201 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 20/60] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:14:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 573 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:14:03.779913 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-6b241131-e03d-4730-aee2-6cd8b12268de tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:03.780643 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-6b241131-e03d-4730-aee2-6cd8b12268de tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:03.909833 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-af3d3867-04db-4437-8093-42a961d3003b tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:03.924129 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-af3d3867-04db-4437-8093-42a961d3003b tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1291 microversion: 2.1 time: 0.310940 Mar 31 18:14:03.926316 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 41/61] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:03 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1291 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:03.931582 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-6b241131-e03d-4730-aee2-6cd8b12268de tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:03.953028 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-6b241131-e03d-4730-aee2-6cd8b12268de tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:03.954545 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-6b241131-e03d-4730-aee2-6cd8b12268de tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:03.964232 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-d6aa1cd6-e4d6-4e38-9005-20d5703ac57a tempest-VolumesNegativeTest-321645948 tempest-VolumesNegativeTest-321645948-project] Action: 'create', calling method: .version_select at 0x7fa4d4624d30>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1110391168", "metadata": {"Type": "work"}}} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:14:03.964390 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-6b241131-e03d-4730-aee2-6cd8b12268de tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1282 microversion: 2.20 time: 0.188480 Mar 31 18:14:03.964531 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 21/62] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:14:03 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1282 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:14:03.965021 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-d6aa1cd6-e4d6-4e38-9005-20d5703ac57a tempest-VolumesNegativeTest-321645948 tempest-VolumesNegativeTest-321645948-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:14:03.966007 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-d6aa1cd6-e4d6-4e38-9005-20d5703ac57a tempest-VolumesNegativeTest-321645948 tempest-VolumesNegativeTest-321645948-project] 10.222.0.58 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.019166 Mar 31 18:14:03.979862 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 42/63] 10.222.0.58 () {60 vars in 1155 bytes} [Thu Mar 31 18:14:03 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 53 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 31 18:14:03.990087 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-ff63b0fe-dbb7-46e6-a9d8-f676e4878777 tempest-VolumesNegativeTest-321645948 tempest-VolumesNegativeTest-321645948-project] Calling method '.version_select at 0x7fa4d45ea4c0>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:04.163778 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.wsgi [None req-ff63b0fe-dbb7-46e6-a9d8-f676e4878777 tempest-VolumesNegativeTest-321645948 tempest-VolumesNegativeTest-321645948-project] HTTP exception thrown: Volume tempest-invalid-126483712 could not be found. Mar 31 18:14:04.165228 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-ff63b0fe-dbb7-46e6-a9d8-f676e4878777 tempest-VolumesNegativeTest-321645948 tempest-VolumesNegativeTest-321645948-project] Returning 404 to user: Volume tempest-invalid-126483712 could not be found. {{(pid=117539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:14:04.166282 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-ff63b0fe-dbb7-46e6-a9d8-f676e4878777 tempest-VolumesNegativeTest-321645948 tempest-VolumesNegativeTest-321645948-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/tempest-invalid-126483712" status: 404 len: 98 microversion: 2.1 time: 0.180130 Mar 31 18:14:04.167038 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 22/64] 10.222.0.58 () {58 vars in 1214 bytes} [Thu Mar 31 18:14:03 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-126483712 => generated 98 bytes in 181 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Mar 31 18:14:04.181816 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-46509ff0-3f72-4086-b53d-b7282d79ae70 tempest-VolumesNegativeTest-321645948 tempest-VolumesNegativeTest-321645948-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.006198 Mar 31 18:14:04.188447 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 43/65] 10.222.0.58 () {58 vars in 1139 bytes} [Thu Mar 31 18:14:04 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Mar 31 18:14:04.194361 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-8ae31aa2-6e01-416c-9fcc-2b24aad6edf0 tempest-VolumesNegativeTest-321645948 tempest-VolumesNegativeTest-321645948-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004647 Mar 31 18:14:04.215060 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 23/66] 10.222.0.58 () {58 vars in 1136 bytes} [Thu Mar 31 18:14:04 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Mar 31 18:14:04.220574 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-254f5dc4-c7e6-445e-9cef-4ff6cfc2e1bc tempest-VolumesNegativeTest-321645948 tempest-VolumesNegativeTest-321645948-project] Calling method '.version_select at 0x7fa4d4f344c0>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:04.272075 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.wsgi [None req-254f5dc4-c7e6-445e-9cef-4ff6cfc2e1bc tempest-VolumesNegativeTest-321645948 tempest-VolumesNegativeTest-321645948-project] HTTP exception thrown: Volume c48ca310-cd38-445c-ac10-1ca0b2c1e8da could not be found. Mar 31 18:14:04.272721 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-254f5dc4-c7e6-445e-9cef-4ff6cfc2e1bc tempest-VolumesNegativeTest-321645948 tempest-VolumesNegativeTest-321645948-project] Returning 404 to user: Volume c48ca310-cd38-445c-ac10-1ca0b2c1e8da could not be found. {{(pid=117538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:14:04.273802 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-254f5dc4-c7e6-445e-9cef-4ff6cfc2e1bc tempest-VolumesNegativeTest-321645948 tempest-VolumesNegativeTest-321645948-project] 10.222.0.58 "DELETE /compute/v2.1/os-volumes/c48ca310-cd38-445c-ac10-1ca0b2c1e8da" status: 404 len: 109 microversion: 2.1 time: 0.057034 Mar 31 18:14:04.280883 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 44/67] 10.222.0.58 () {58 vars in 1247 bytes} [Thu Mar 31 18:14:04 2022] DELETE /compute/v2.1/os-volumes/c48ca310-cd38-445c-ac10-1ca0b2c1e8da => generated 109 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 31 18:14:04.294662 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-e6c03e8a-9b12-41ba-885c-dca27992858d tempest-VolumesNegativeTest-321645948 tempest-VolumesNegativeTest-321645948-project] Calling method '.version_select at 0x7fa4d4621550>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:04.327884 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.wsgi [None req-e6c03e8a-9b12-41ba-885c-dca27992858d tempest-VolumesNegativeTest-321645948 tempest-VolumesNegativeTest-321645948-project] HTTP exception thrown: Volume c7ed0520-f96b-4957-b716-3f17429e7758 could not be found. Mar 31 18:14:04.328488 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-e6c03e8a-9b12-41ba-885c-dca27992858d tempest-VolumesNegativeTest-321645948 tempest-VolumesNegativeTest-321645948-project] Returning 404 to user: Volume c7ed0520-f96b-4957-b716-3f17429e7758 could not be found. {{(pid=117539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:14:04.329319 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-e6c03e8a-9b12-41ba-885c-dca27992858d tempest-VolumesNegativeTest-321645948 tempest-VolumesNegativeTest-321645948-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/c7ed0520-f96b-4957-b716-3f17429e7758" status: 404 len: 109 microversion: 2.1 time: 0.046537 Mar 31 18:14:04.342272 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 24/68] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Mar 31 18:14:04 2022] GET /compute/v2.1/os-volumes/c7ed0520-f96b-4957-b716-3f17429e7758 => generated 109 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 31 18:14:04.562721 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-245877ca-83ce-4d5c-aa85-bec7448ea63e tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:04.563494 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-245877ca-83ce-4d5c-aa85-bec7448ea63e tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:04.576957 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-245877ca-83ce-4d5c-aa85-bec7448ea63e tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:04.578036 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-245877ca-83ce-4d5c-aa85-bec7448ea63e tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:04.579623 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-245877ca-83ce-4d5c-aa85-bec7448ea63e tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:04.580400 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-245877ca-83ce-4d5c-aa85-bec7448ea63e tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:04.876439 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-245877ca-83ce-4d5c-aa85-bec7448ea63e tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1dacde91404110b259cfab7a37bb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23366fa77e9049af8c183f6959cc158f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:04.888488 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-245877ca-83ce-4d5c-aa85-bec7448ea63e tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] 10.222.0.58 "GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e" status: 200 len: 1314 microversion: 2.1 time: 0.330400 Mar 31 18:14:04.891280 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 45/69] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:04 2022] GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e => generated 1314 bytes in 334 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:04.950958 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-9006d62d-211a-46fa-90cd-3e3c460be348 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:04.951748 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-9006d62d-211a-46fa-90cd-3e3c460be348 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:04.966711 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9006d62d-211a-46fa-90cd-3e3c460be348 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:04.968897 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9006d62d-211a-46fa-90cd-3e3c460be348 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:04.971358 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9006d62d-211a-46fa-90cd-3e3c460be348 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:04.972133 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9006d62d-211a-46fa-90cd-3e3c460be348 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:04.989996 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-1d31243e-b183-4227-9f42-9d614bd152e3 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:04.990737 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-1d31243e-b183-4227-9f42-9d614bd152e3 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:05.106214 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-1d31243e-b183-4227-9f42-9d614bd152e3 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:05.113494 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-9006d62d-211a-46fa-90cd-3e3c460be348 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:05.114823 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-1d31243e-b183-4227-9f42-9d614bd152e3 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:05.126410 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-1d31243e-b183-4227-9f42-9d614bd152e3 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:05.127729 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-1d31243e-b183-4227-9f42-9d614bd152e3 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1282 microversion: 2.20 time: 0.143288 Mar 31 18:14:05.128447 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 46/70] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:14:04 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1282 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 31 18:14:05.128823 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-9006d62d-211a-46fa-90cd-3e3c460be348 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1279 microversion: 2.1 time: 0.184962 Mar 31 18:14:05.135562 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 25/71] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:04 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1279 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:05.908001 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-fec66449-4c38-4d5d-b2a1-5319ac5044e5 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:05.911474 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-fec66449-4c38-4d5d-b2a1-5319ac5044e5 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:05.922929 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-fec66449-4c38-4d5d-b2a1-5319ac5044e5 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:05.923662 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-fec66449-4c38-4d5d-b2a1-5319ac5044e5 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:05.924588 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-fec66449-4c38-4d5d-b2a1-5319ac5044e5 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:05.925239 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-fec66449-4c38-4d5d-b2a1-5319ac5044e5 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:06.151561 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-1f07d68d-5109-4468-bfed-73fceb131a8f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:06.152795 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-1f07d68d-5109-4468-bfed-73fceb131a8f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:06.168156 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1f07d68d-5109-4468-bfed-73fceb131a8f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:06.172964 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1f07d68d-5109-4468-bfed-73fceb131a8f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:06.173950 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1f07d68d-5109-4468-bfed-73fceb131a8f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:06.174496 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1f07d68d-5109-4468-bfed-73fceb131a8f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:06.182669 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-fec66449-4c38-4d5d-b2a1-5319ac5044e5 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1dacde91404110b259cfab7a37bb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23366fa77e9049af8c183f6959cc158f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:06.193125 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-fec66449-4c38-4d5d-b2a1-5319ac5044e5 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] 10.222.0.58 "GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e" status: 200 len: 1314 microversion: 2.1 time: 0.289100 Mar 31 18:14:06.196803 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 47/72] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:05 2022] GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:06.213218 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-2f543f87-832e-4758-b0c2-e27aa260dc6a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:06.215279 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-2f543f87-832e-4758-b0c2-e27aa260dc6a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:06.229748 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-2f543f87-832e-4758-b0c2-e27aa260dc6a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:06.230208 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-2f543f87-832e-4758-b0c2-e27aa260dc6a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:06.231037 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-2f543f87-832e-4758-b0c2-e27aa260dc6a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:06.231726 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-2f543f87-832e-4758-b0c2-e27aa260dc6a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:06.272225 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-1f07d68d-5109-4468-bfed-73fceb131a8f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:06.292569 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-1f07d68d-5109-4468-bfed-73fceb131a8f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:06.294889 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-1f07d68d-5109-4468-bfed-73fceb131a8f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:06.296956 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-1f07d68d-5109-4468-bfed-73fceb131a8f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1286 microversion: 2.20 time: 0.151406 Mar 31 18:14:06.298396 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 26/73] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:14:06 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1286 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:14:06.480983 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-2f543f87-832e-4758-b0c2-e27aa260dc6a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:06.490271 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-2f543f87-832e-4758-b0c2-e27aa260dc6a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1321 microversion: 2.1 time: 0.290876 Mar 31 18:14:06.492818 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 48/74] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:06 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1321 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:06.783231 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [req-88f92117-db55-49dd-816e-12a9aa79119b req-0789be10-4dfc-481a-a784-8d9a9815d289 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "779c13cd-7a7a-47b4-b488-0d1e365c3dc4", "tag": "a16d9c5f-04bd-414b-a468-f0a9a47b917b"}]} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:14:06.795445 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-88f92117-db55-49dd-816e-12a9aa79119b req-0789be10-4dfc-481a-a784-8d9a9815d289 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:06.797616 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-88f92117-db55-49dd-816e-12a9aa79119b req-0789be10-4dfc-481a-a784-8d9a9815d289 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:06.852922 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.compute.server_external_events [req-88f92117-db55-49dd-816e-12a9aa79119b req-0789be10-4dfc-481a-a784-8d9a9815d289 service nova] Creating event network-changed:a16d9c5f-04bd-414b-a468-f0a9a47b917b for instance 779c13cd-7a7a-47b4-b488-0d1e365c3dc4 on hv-cinder-maste Mar 31 18:14:06.877543 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [req-88f92117-db55-49dd-816e-12a9aa79119b req-0789be10-4dfc-481a-a784-8d9a9815d289 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.577420 Mar 31 18:14:06.878413 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 27/75] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:14:07.214425 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-8bdf19ac-a0f0-4835-8908-ec4e8f5cd77b tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:07.215174 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-8bdf19ac-a0f0-4835-8908-ec4e8f5cd77b tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:07.227186 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8bdf19ac-a0f0-4835-8908-ec4e8f5cd77b tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:07.227652 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8bdf19ac-a0f0-4835-8908-ec4e8f5cd77b tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:07.228549 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8bdf19ac-a0f0-4835-8908-ec4e8f5cd77b tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:07.228894 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8bdf19ac-a0f0-4835-8908-ec4e8f5cd77b tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:07.316294 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-3687760c-c550-42a5-b193-cd24b8187021 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:07.328949 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-3687760c-c550-42a5-b193-cd24b8187021 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:07.353907 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3687760c-c550-42a5-b193-cd24b8187021 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:07.356268 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3687760c-c550-42a5-b193-cd24b8187021 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:07.357468 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3687760c-c550-42a5-b193-cd24b8187021 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:07.359132 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3687760c-c550-42a5-b193-cd24b8187021 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:07.510843 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-3687760c-c550-42a5-b193-cd24b8187021 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:07.521766 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-3687760c-c550-42a5-b193-cd24b8187021 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:07.528242 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-3687760c-c550-42a5-b193-cd24b8187021 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:07.530070 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-3687760c-c550-42a5-b193-cd24b8187021 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1286 microversion: 2.20 time: 0.219070 Mar 31 18:14:07.533099 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 28/76] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:14:07 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1286 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:14:07.541934 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-45efaa17-653f-47b2-8e35-b7c0de7e831b tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:07.543556 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-45efaa17-653f-47b2-8e35-b7c0de7e831b tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:07.551237 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-8bdf19ac-a0f0-4835-8908-ec4e8f5cd77b tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1dacde91404110b259cfab7a37bb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23366fa77e9049af8c183f6959cc158f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:07.558783 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-45efaa17-653f-47b2-8e35-b7c0de7e831b tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:07.559240 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-45efaa17-653f-47b2-8e35-b7c0de7e831b tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:07.560020 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-45efaa17-653f-47b2-8e35-b7c0de7e831b tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:07.560887 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-8bdf19ac-a0f0-4835-8908-ec4e8f5cd77b tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] 10.222.0.58 "GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e" status: 200 len: 1314 microversion: 2.1 time: 0.351986 Mar 31 18:14:07.564650 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-45efaa17-653f-47b2-8e35-b7c0de7e831b tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:07.571269 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 49/77] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:07 2022] GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e => generated 1314 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:07.865840 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-45efaa17-653f-47b2-8e35-b7c0de7e831b tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:07.903349 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-45efaa17-653f-47b2-8e35-b7c0de7e831b tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1321 microversion: 2.1 time: 0.358631 Mar 31 18:14:07.904825 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 29/78] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:07 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1321 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:08.553610 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-b0a6517b-52ed-4553-a107-9a1f9a77ad27 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:08.555709 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-b0a6517b-52ed-4553-a107-9a1f9a77ad27 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:08.565783 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b0a6517b-52ed-4553-a107-9a1f9a77ad27 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:08.567826 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b0a6517b-52ed-4553-a107-9a1f9a77ad27 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:08.569677 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b0a6517b-52ed-4553-a107-9a1f9a77ad27 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:08.573328 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b0a6517b-52ed-4553-a107-9a1f9a77ad27 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:08.581341 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-e48b8b30-a840-412f-8213-2beabd24ddfd tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:08.582417 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-e48b8b30-a840-412f-8213-2beabd24ddfd tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:08.591924 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e48b8b30-a840-412f-8213-2beabd24ddfd tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:08.593172 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e48b8b30-a840-412f-8213-2beabd24ddfd tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:08.594707 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e48b8b30-a840-412f-8213-2beabd24ddfd tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:08.595141 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e48b8b30-a840-412f-8213-2beabd24ddfd tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:08.670908 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-b0a6517b-52ed-4553-a107-9a1f9a77ad27 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:08.687235 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-b0a6517b-52ed-4553-a107-9a1f9a77ad27 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:08.689802 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-b0a6517b-52ed-4553-a107-9a1f9a77ad27 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:08.692632 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-b0a6517b-52ed-4553-a107-9a1f9a77ad27 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1286 microversion: 2.20 time: 0.144351 Mar 31 18:14:08.693926 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 50/79] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:14:08 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1286 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:14:08.749762 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-e48b8b30-a840-412f-8213-2beabd24ddfd tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1dacde91404110b259cfab7a37bb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23366fa77e9049af8c183f6959cc158f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:08.758292 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-e48b8b30-a840-412f-8213-2beabd24ddfd tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] 10.222.0.58 "GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e" status: 200 len: 1314 microversion: 2.1 time: 0.183458 Mar 31 18:14:08.758948 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 30/80] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:08 2022] GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:08.965241 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-cc1c6f2f-0210-48b1-a449-99b80bf4d3db tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:08.965952 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-cc1c6f2f-0210-48b1-a449-99b80bf4d3db tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:08.981131 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-cc1c6f2f-0210-48b1-a449-99b80bf4d3db tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:08.983742 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-cc1c6f2f-0210-48b1-a449-99b80bf4d3db tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:08.986477 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-cc1c6f2f-0210-48b1-a449-99b80bf4d3db tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:08.987285 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-cc1c6f2f-0210-48b1-a449-99b80bf4d3db tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:09.184971 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-cc1c6f2f-0210-48b1-a449-99b80bf4d3db tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:09.194793 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-cc1c6f2f-0210-48b1-a449-99b80bf4d3db tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1321 microversion: 2.1 time: 0.235576 Mar 31 18:14:09.195452 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 51/81] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:08 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1321 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:09.266991 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [req-53e2928d-c894-40a8-af07-b8c1d0ea85a9 req-1d051631-4fe9-43af-8765-135081cf1e4b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "62ef59ed-5ec0-4452-9708-184340fa4f7f", "tag": "9426b740-3eca-421b-a5c0-b9ab2601eebd"}]} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:14:09.276865 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-53e2928d-c894-40a8-af07-b8c1d0ea85a9 req-1d051631-4fe9-43af-8765-135081cf1e4b service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:09.277529 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-53e2928d-c894-40a8-af07-b8c1d0ea85a9 req-1d051631-4fe9-43af-8765-135081cf1e4b service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:09.295098 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.compute.server_external_events [req-53e2928d-c894-40a8-af07-b8c1d0ea85a9 req-1d051631-4fe9-43af-8765-135081cf1e4b service nova] Creating event network-changed:9426b740-3eca-421b-a5c0-b9ab2601eebd for instance 62ef59ed-5ec0-4452-9708-184340fa4f7f on hv-cinder-maste Mar 31 18:14:09.300643 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [req-53e2928d-c894-40a8-af07-b8c1d0ea85a9 req-1d051631-4fe9-43af-8765-135081cf1e4b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037596 Mar 31 18:14:09.301627 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 31/82] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:14:09.711660 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-403efda6-d064-46ea-85e3-60ed5474d2ee tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:09.712354 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-403efda6-d064-46ea-85e3-60ed5474d2ee tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:09.719561 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-403efda6-d064-46ea-85e3-60ed5474d2ee tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:09.720039 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-403efda6-d064-46ea-85e3-60ed5474d2ee tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:09.720965 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-403efda6-d064-46ea-85e3-60ed5474d2ee tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:09.721427 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-403efda6-d064-46ea-85e3-60ed5474d2ee tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:09.776157 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-d71ae010-11f0-4cfc-a276-5521c3ebda0e tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:09.777576 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-d71ae010-11f0-4cfc-a276-5521c3ebda0e tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:09.782983 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-403efda6-d064-46ea-85e3-60ed5474d2ee tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:09.784649 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-d71ae010-11f0-4cfc-a276-5521c3ebda0e tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:09.785290 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-d71ae010-11f0-4cfc-a276-5521c3ebda0e tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:09.786058 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-d71ae010-11f0-4cfc-a276-5521c3ebda0e tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:09.787207 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-d71ae010-11f0-4cfc-a276-5521c3ebda0e tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:09.793314 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-403efda6-d064-46ea-85e3-60ed5474d2ee tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:09.795087 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-403efda6-d064-46ea-85e3-60ed5474d2ee tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:09.796186 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-403efda6-d064-46ea-85e3-60ed5474d2ee tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1278 microversion: 2.20 time: 0.089400 Mar 31 18:14:09.796913 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 52/83] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:14:09 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1278 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:14:09.929583 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-d71ae010-11f0-4cfc-a276-5521c3ebda0e tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1dacde91404110b259cfab7a37bb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23366fa77e9049af8c183f6959cc158f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:09.937133 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-d71ae010-11f0-4cfc-a276-5521c3ebda0e tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] 10.222.0.58 "GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e" status: 200 len: 1314 microversion: 2.1 time: 0.166312 Mar 31 18:14:09.937709 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 32/84] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:09 2022] GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:10.211726 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-f9d4126e-46d7-4e23-9a32-145f5c58fb18 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:10.212332 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-f9d4126e-46d7-4e23-9a32-145f5c58fb18 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:10.218259 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f9d4126e-46d7-4e23-9a32-145f5c58fb18 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:10.218917 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f9d4126e-46d7-4e23-9a32-145f5c58fb18 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:10.219862 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f9d4126e-46d7-4e23-9a32-145f5c58fb18 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:10.220284 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f9d4126e-46d7-4e23-9a32-145f5c58fb18 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:10.361254 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-f9d4126e-46d7-4e23-9a32-145f5c58fb18 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:10.369692 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-f9d4126e-46d7-4e23-9a32-145f5c58fb18 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1321 microversion: 2.1 time: 0.161661 Mar 31 18:14:10.370376 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 53/85] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:10 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1321 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:10.817460 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-af7711c2-31f2-47a1-a07e-b5bd79cf6f43 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:10.817460 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-af7711c2-31f2-47a1-a07e-b5bd79cf6f43 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:10.821069 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-af7711c2-31f2-47a1-a07e-b5bd79cf6f43 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:10.821517 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-af7711c2-31f2-47a1-a07e-b5bd79cf6f43 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:10.822290 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-af7711c2-31f2-47a1-a07e-b5bd79cf6f43 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:10.822740 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-af7711c2-31f2-47a1-a07e-b5bd79cf6f43 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:10.897480 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-af7711c2-31f2-47a1-a07e-b5bd79cf6f43 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:10.906077 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-af7711c2-31f2-47a1-a07e-b5bd79cf6f43 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:10.907953 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-af7711c2-31f2-47a1-a07e-b5bd79cf6f43 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:10.909618 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-af7711c2-31f2-47a1-a07e-b5bd79cf6f43 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1278 microversion: 2.20 time: 0.098603 Mar 31 18:14:10.909618 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 33/86] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:14:10 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1278 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:14:10.954871 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-1a6fe017-6d46-4a86-b438-49c578559c52 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:10.955478 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-1a6fe017-6d46-4a86-b438-49c578559c52 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:10.962189 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-1a6fe017-6d46-4a86-b438-49c578559c52 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:10.962665 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-1a6fe017-6d46-4a86-b438-49c578559c52 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:10.963437 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-1a6fe017-6d46-4a86-b438-49c578559c52 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:10.963868 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-1a6fe017-6d46-4a86-b438-49c578559c52 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:11.113966 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-1a6fe017-6d46-4a86-b438-49c578559c52 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1dacde91404110b259cfab7a37bb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23366fa77e9049af8c183f6959cc158f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:11.123985 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-1a6fe017-6d46-4a86-b438-49c578559c52 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] 10.222.0.58 "GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e" status: 200 len: 1314 microversion: 2.1 time: 0.172817 Mar 31 18:14:11.124493 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 54/87] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:10 2022] GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e => generated 1314 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:11.386386 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-165de809-a405-4861-a0c4-5824eca65331 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:11.386917 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-165de809-a405-4861-a0c4-5824eca65331 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:11.392712 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-165de809-a405-4861-a0c4-5824eca65331 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:11.393148 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-165de809-a405-4861-a0c4-5824eca65331 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:11.393900 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-165de809-a405-4861-a0c4-5824eca65331 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:11.394327 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-165de809-a405-4861-a0c4-5824eca65331 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:11.531831 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-165de809-a405-4861-a0c4-5824eca65331 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:11.540162 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-165de809-a405-4861-a0c4-5824eca65331 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1321 microversion: 2.1 time: 0.157619 Mar 31 18:14:11.540768 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 34/88] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:11 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:11.929070 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-c94bb67e-d6e0-4d38-a8cf-4c1d2a08e1d5 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:11.929691 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-c94bb67e-d6e0-4d38-a8cf-4c1d2a08e1d5 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:11.935812 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c94bb67e-d6e0-4d38-a8cf-4c1d2a08e1d5 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:11.936500 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c94bb67e-d6e0-4d38-a8cf-4c1d2a08e1d5 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:11.937305 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c94bb67e-d6e0-4d38-a8cf-4c1d2a08e1d5 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:11.937731 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c94bb67e-d6e0-4d38-a8cf-4c1d2a08e1d5 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:11.997910 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-c94bb67e-d6e0-4d38-a8cf-4c1d2a08e1d5 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:12.006759 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-c94bb67e-d6e0-4d38-a8cf-4c1d2a08e1d5 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:12.008386 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-c94bb67e-d6e0-4d38-a8cf-4c1d2a08e1d5 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:12.009684 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-c94bb67e-d6e0-4d38-a8cf-4c1d2a08e1d5 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1278 microversion: 2.20 time: 0.085292 Mar 31 18:14:12.016749 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 55/89] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:14:11 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1278 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:14:12.142932 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-0ea0af69-d66b-430e-b02f-c28961a88a37 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:12.143535 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-0ea0af69-d66b-430e-b02f-c28961a88a37 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:12.149599 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0ea0af69-d66b-430e-b02f-c28961a88a37 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:12.150039 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0ea0af69-d66b-430e-b02f-c28961a88a37 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:12.150820 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0ea0af69-d66b-430e-b02f-c28961a88a37 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:12.151250 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0ea0af69-d66b-430e-b02f-c28961a88a37 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:12.286775 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-0ea0af69-d66b-430e-b02f-c28961a88a37 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1dacde91404110b259cfab7a37bb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23366fa77e9049af8c183f6959cc158f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:12.295094 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-0ea0af69-d66b-430e-b02f-c28961a88a37 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] 10.222.0.58 "GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e" status: 200 len: 1314 microversion: 2.1 time: 0.156006 Mar 31 18:14:12.297063 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 35/90] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:12 2022] GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:12.561259 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-1f3c6821-80fc-40fc-be11-e3e182169d09 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:12.561858 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-1f3c6821-80fc-40fc-be11-e3e182169d09 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:12.567808 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-1f3c6821-80fc-40fc-be11-e3e182169d09 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:12.568249 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-1f3c6821-80fc-40fc-be11-e3e182169d09 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:12.569004 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-1f3c6821-80fc-40fc-be11-e3e182169d09 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:12.569431 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-1f3c6821-80fc-40fc-be11-e3e182169d09 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:12.706472 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-1f3c6821-80fc-40fc-be11-e3e182169d09 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:12.714387 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-1f3c6821-80fc-40fc-be11-e3e182169d09 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1321 microversion: 2.1 time: 0.156955 Mar 31 18:14:12.714993 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 56/91] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:12 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1321 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:13.032711 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-e6febe4e-da4a-4e0a-8527-d2d8ad4f2322 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:13.033388 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-e6febe4e-da4a-4e0a-8527-d2d8ad4f2322 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:13.040174 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e6febe4e-da4a-4e0a-8527-d2d8ad4f2322 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:13.040616 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e6febe4e-da4a-4e0a-8527-d2d8ad4f2322 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:13.041378 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e6febe4e-da4a-4e0a-8527-d2d8ad4f2322 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:13.041805 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e6febe4e-da4a-4e0a-8527-d2d8ad4f2322 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:13.106846 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-e6febe4e-da4a-4e0a-8527-d2d8ad4f2322 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:13.115350 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-e6febe4e-da4a-4e0a-8527-d2d8ad4f2322 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:13.117187 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-e6febe4e-da4a-4e0a-8527-d2d8ad4f2322 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:13.118289 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-e6febe4e-da4a-4e0a-8527-d2d8ad4f2322 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1278 microversion: 2.20 time: 0.094590 Mar 31 18:14:13.118881 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 36/92] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:14:13 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1278 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:14:13.312839 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-8eb48563-e3a7-4c2d-922e-b44c36144bff tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:13.313468 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-8eb48563-e3a7-4c2d-922e-b44c36144bff tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:13.320192 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8eb48563-e3a7-4c2d-922e-b44c36144bff tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:13.320640 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8eb48563-e3a7-4c2d-922e-b44c36144bff tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:13.321430 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8eb48563-e3a7-4c2d-922e-b44c36144bff tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:13.321862 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8eb48563-e3a7-4c2d-922e-b44c36144bff tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:13.459241 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-8eb48563-e3a7-4c2d-922e-b44c36144bff tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1dacde91404110b259cfab7a37bb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23366fa77e9049af8c183f6959cc158f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:13.466950 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-8eb48563-e3a7-4c2d-922e-b44c36144bff tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] 10.222.0.58 "GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e" status: 200 len: 1314 microversion: 2.1 time: 0.157978 Mar 31 18:14:13.467527 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 57/93] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:13 2022] GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:13.732109 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-d73bf03e-5f73-4557-9b2d-1a97c83303b2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:13.732879 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-d73bf03e-5f73-4557-9b2d-1a97c83303b2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:13.739467 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-d73bf03e-5f73-4557-9b2d-1a97c83303b2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:13.740518 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-d73bf03e-5f73-4557-9b2d-1a97c83303b2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:13.741731 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-d73bf03e-5f73-4557-9b2d-1a97c83303b2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:13.742161 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-d73bf03e-5f73-4557-9b2d-1a97c83303b2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:13.888693 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-d73bf03e-5f73-4557-9b2d-1a97c83303b2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:13.896088 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-d73bf03e-5f73-4557-9b2d-1a97c83303b2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1321 microversion: 2.1 time: 0.167897 Mar 31 18:14:13.899310 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 37/94] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:13 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1321 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:14.136974 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-576971b3-40e2-4d4b-baa7-291cccf63d27 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:14.138074 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-576971b3-40e2-4d4b-baa7-291cccf63d27 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:14.148153 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-576971b3-40e2-4d4b-baa7-291cccf63d27 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:14.149151 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-576971b3-40e2-4d4b-baa7-291cccf63d27 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:14.150139 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-576971b3-40e2-4d4b-baa7-291cccf63d27 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:14.150825 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-576971b3-40e2-4d4b-baa7-291cccf63d27 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:14.300898 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-576971b3-40e2-4d4b-baa7-291cccf63d27 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:14.321770 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-576971b3-40e2-4d4b-baa7-291cccf63d27 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:14.327028 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-576971b3-40e2-4d4b-baa7-291cccf63d27 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:14.330544 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-576971b3-40e2-4d4b-baa7-291cccf63d27 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1278 microversion: 2.20 time: 0.197798 Mar 31 18:14:14.331306 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 58/95] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:14:14 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1278 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:14:14.484871 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-1e6e50b3-2b83-4568-aa49-cd3b0803ae6b tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:14.485836 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-1e6e50b3-2b83-4568-aa49-cd3b0803ae6b tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:14.492716 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1e6e50b3-2b83-4568-aa49-cd3b0803ae6b tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:14.493163 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1e6e50b3-2b83-4568-aa49-cd3b0803ae6b tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:14.494002 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1e6e50b3-2b83-4568-aa49-cd3b0803ae6b tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:14.494512 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1e6e50b3-2b83-4568-aa49-cd3b0803ae6b tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:14.700473 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-1e6e50b3-2b83-4568-aa49-cd3b0803ae6b tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1dacde91404110b259cfab7a37bb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23366fa77e9049af8c183f6959cc158f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:14.715210 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-1e6e50b3-2b83-4568-aa49-cd3b0803ae6b tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] 10.222.0.58 "GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e" status: 200 len: 1314 microversion: 2.1 time: 0.234562 Mar 31 18:14:14.716205 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 38/96] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:14 2022] GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:14.913502 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-c22fb4c0-0928-4633-8059-41677b9029c2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:14.914114 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-c22fb4c0-0928-4633-8059-41677b9029c2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:14.920739 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c22fb4c0-0928-4633-8059-41677b9029c2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:14.921182 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c22fb4c0-0928-4633-8059-41677b9029c2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:14.921949 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c22fb4c0-0928-4633-8059-41677b9029c2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:14.922372 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c22fb4c0-0928-4633-8059-41677b9029c2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:15.179096 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-c22fb4c0-0928-4633-8059-41677b9029c2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:15.186369 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-c22fb4c0-0928-4633-8059-41677b9029c2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1321 microversion: 2.1 time: 0.277377 Mar 31 18:14:15.186981 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 59/97] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:14 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1321 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:15.351502 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-ed64c798-6ce2-40de-8e46-cae8a5e55f12 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:15.352121 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-ed64c798-6ce2-40de-8e46-cae8a5e55f12 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:15.358971 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ed64c798-6ce2-40de-8e46-cae8a5e55f12 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:15.359414 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ed64c798-6ce2-40de-8e46-cae8a5e55f12 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:15.360180 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ed64c798-6ce2-40de-8e46-cae8a5e55f12 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:15.360598 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ed64c798-6ce2-40de-8e46-cae8a5e55f12 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:15.430684 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-ed64c798-6ce2-40de-8e46-cae8a5e55f12 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:15.438747 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-ed64c798-6ce2-40de-8e46-cae8a5e55f12 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:15.440236 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-ed64c798-6ce2-40de-8e46-cae8a5e55f12 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:15.441328 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-ed64c798-6ce2-40de-8e46-cae8a5e55f12 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1342 microversion: 2.20 time: 0.094531 Mar 31 18:14:15.441885 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 39/98] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:14:15 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1342 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:14:15.742279 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-f8addf09-6f0d-4788-a495-5a3996201859 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:15.743587 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-f8addf09-6f0d-4788-a495-5a3996201859 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:15.763251 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f8addf09-6f0d-4788-a495-5a3996201859 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:15.771606 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f8addf09-6f0d-4788-a495-5a3996201859 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:15.772671 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f8addf09-6f0d-4788-a495-5a3996201859 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:15.773121 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f8addf09-6f0d-4788-a495-5a3996201859 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:15.939014 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-f8addf09-6f0d-4788-a495-5a3996201859 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1dacde91404110b259cfab7a37bb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23366fa77e9049af8c183f6959cc158f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:15.947904 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-f8addf09-6f0d-4788-a495-5a3996201859 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] 10.222.0.58 "GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e" status: 200 len: 1314 microversion: 2.1 time: 0.218866 Mar 31 18:14:15.948490 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 60/99] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:15 2022] GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e => generated 1314 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:16.210992 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-a92a7c28-55be-46d5-aecd-62f322dce77a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:16.211733 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-a92a7c28-55be-46d5-aecd-62f322dce77a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:16.228561 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a92a7c28-55be-46d5-aecd-62f322dce77a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:16.228561 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a92a7c28-55be-46d5-aecd-62f322dce77a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:16.228561 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a92a7c28-55be-46d5-aecd-62f322dce77a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:16.228561 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a92a7c28-55be-46d5-aecd-62f322dce77a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:16.461395 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-53f04627-a7f1-4262-b1b8-a343a2f6ca1e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:16.462076 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-53f04627-a7f1-4262-b1b8-a343a2f6ca1e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:16.469495 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-53f04627-a7f1-4262-b1b8-a343a2f6ca1e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:16.469941 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-53f04627-a7f1-4262-b1b8-a343a2f6ca1e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:16.470958 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-53f04627-a7f1-4262-b1b8-a343a2f6ca1e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:16.471521 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-53f04627-a7f1-4262-b1b8-a343a2f6ca1e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:16.520506 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-a92a7c28-55be-46d5-aecd-62f322dce77a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:16.528858 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-a92a7c28-55be-46d5-aecd-62f322dce77a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1321 microversion: 2.1 time: 0.322613 Mar 31 18:14:16.542645 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 40/100] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:16 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1321 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:16.544099 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-53f04627-a7f1-4262-b1b8-a343a2f6ca1e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:16.552728 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-53f04627-a7f1-4262-b1b8-a343a2f6ca1e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:16.554227 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-53f04627-a7f1-4262-b1b8-a343a2f6ca1e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:16.555362 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-53f04627-a7f1-4262-b1b8-a343a2f6ca1e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1340 microversion: 2.20 time: 0.098966 Mar 31 18:14:16.555920 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 61/101] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:14:16 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1340 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 31 18:14:16.965139 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-156bebcb-09cd-4551-9f85-b453e7cfa0bc tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:16.965763 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-156bebcb-09cd-4551-9f85-b453e7cfa0bc tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:16.972071 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-156bebcb-09cd-4551-9f85-b453e7cfa0bc tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:16.972514 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-156bebcb-09cd-4551-9f85-b453e7cfa0bc tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:16.973845 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-156bebcb-09cd-4551-9f85-b453e7cfa0bc tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:16.974390 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-156bebcb-09cd-4551-9f85-b453e7cfa0bc tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:17.129212 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-156bebcb-09cd-4551-9f85-b453e7cfa0bc tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1dacde91404110b259cfab7a37bb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23366fa77e9049af8c183f6959cc158f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:17.138079 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-156bebcb-09cd-4551-9f85-b453e7cfa0bc tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] 10.222.0.58 "GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e" status: 200 len: 1314 microversion: 2.1 time: 0.177537 Mar 31 18:14:17.138981 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 41/102] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:16 2022] GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:17.549553 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-bcda004b-33b6-4bc8-a150-bc9ce2b78d92 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:17.553184 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-bcda004b-33b6-4bc8-a150-bc9ce2b78d92 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:17.560252 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-bcda004b-33b6-4bc8-a150-bc9ce2b78d92 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:17.561123 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-bcda004b-33b6-4bc8-a150-bc9ce2b78d92 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:17.562099 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-bcda004b-33b6-4bc8-a150-bc9ce2b78d92 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:17.563387 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-bcda004b-33b6-4bc8-a150-bc9ce2b78d92 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:17.574839 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-154dc0ba-ade4-4378-ab1f-8496c603574e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:17.577583 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-154dc0ba-ade4-4378-ab1f-8496c603574e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:17.590082 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-154dc0ba-ade4-4378-ab1f-8496c603574e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:17.590519 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-154dc0ba-ade4-4378-ab1f-8496c603574e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:17.595710 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-154dc0ba-ade4-4378-ab1f-8496c603574e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:17.596133 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-154dc0ba-ade4-4378-ab1f-8496c603574e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:17.779745 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-154dc0ba-ade4-4378-ab1f-8496c603574e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:17.789219 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-154dc0ba-ade4-4378-ab1f-8496c603574e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:17.790851 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-154dc0ba-ade4-4378-ab1f-8496c603574e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:17.792312 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-154dc0ba-ade4-4378-ab1f-8496c603574e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1408 microversion: 2.20 time: 0.221759 Mar 31 18:14:17.796197 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 42/103] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:14:17 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1408 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:14:17.808695 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [req-a14f9d82-03d4-4dbf-8d43-28243f862ad5 req-e171a45c-92f4-4f30-8757-c86858b26ca3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0", "tag": "3bfd294a-f954-4562-8fbf-0cd104ab3bee"}]} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:14:17.821127 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-a14f9d82-03d4-4dbf-8d43-28243f862ad5 req-e171a45c-92f4-4f30-8757-c86858b26ca3 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:17.821364 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-a14f9d82-03d4-4dbf-8d43-28243f862ad5 req-e171a45c-92f4-4f30-8757-c86858b26ca3 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:17.826226 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-bcda004b-33b6-4bc8-a150-bc9ce2b78d92 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:17.843441 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-bcda004b-33b6-4bc8-a150-bc9ce2b78d92 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1321 microversion: 2.1 time: 0.301271 Mar 31 18:14:17.847007 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.compute.server_external_events [req-a14f9d82-03d4-4dbf-8d43-28243f862ad5 req-e171a45c-92f4-4f30-8757-c86858b26ca3 service nova] Creating event network-changed:3bfd294a-f954-4562-8fbf-0cd104ab3bee for instance 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 on hv-cinder-maste Mar 31 18:14:17.857273 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 62/104] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:17 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1321 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:17.858668 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [req-a14f9d82-03d4-4dbf-8d43-28243f862ad5 req-e171a45c-92f4-4f30-8757-c86858b26ca3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054755 Mar 31 18:14:17.862937 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 43/105] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:14:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:14:18.157000 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-92633404-9fba-485a-8815-bf44612ab7a0 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:18.157817 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-92633404-9fba-485a-8815-bf44612ab7a0 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:18.166710 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-92633404-9fba-485a-8815-bf44612ab7a0 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:18.167394 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-92633404-9fba-485a-8815-bf44612ab7a0 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:18.168571 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-92633404-9fba-485a-8815-bf44612ab7a0 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:18.169585 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-92633404-9fba-485a-8815-bf44612ab7a0 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:18.343874 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-92633404-9fba-485a-8815-bf44612ab7a0 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1dacde91404110b259cfab7a37bb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23366fa77e9049af8c183f6959cc158f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:18.351987 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-92633404-9fba-485a-8815-bf44612ab7a0 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] 10.222.0.58 "GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e" status: 200 len: 1314 microversion: 2.1 time: 0.198812 Mar 31 18:14:18.352549 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 63/106] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:18 2022] GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e => generated 1314 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:18.813294 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-5886d05a-b8f1-458a-bafc-6f073a09fa73 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:18.813988 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-5886d05a-b8f1-458a-bafc-6f073a09fa73 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:18.820720 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-5886d05a-b8f1-458a-bafc-6f073a09fa73 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:18.821157 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-5886d05a-b8f1-458a-bafc-6f073a09fa73 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:18.821925 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-5886d05a-b8f1-458a-bafc-6f073a09fa73 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:18.822352 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-5886d05a-b8f1-458a-bafc-6f073a09fa73 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:18.869615 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-5054d5b0-3fbf-4169-b7b9-8f5f3c281073 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:18.871065 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-5054d5b0-3fbf-4169-b7b9-8f5f3c281073 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:18.877345 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-5054d5b0-3fbf-4169-b7b9-8f5f3c281073 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:18.877884 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-5054d5b0-3fbf-4169-b7b9-8f5f3c281073 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:18.878680 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-5054d5b0-3fbf-4169-b7b9-8f5f3c281073 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:18.880062 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-5054d5b0-3fbf-4169-b7b9-8f5f3c281073 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:18.971978 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-5886d05a-b8f1-458a-bafc-6f073a09fa73 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:18.985770 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-5886d05a-b8f1-458a-bafc-6f073a09fa73 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:18.985770 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-5886d05a-b8f1-458a-bafc-6f073a09fa73 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:18.986377 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-5886d05a-b8f1-458a-bafc-6f073a09fa73 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1408 microversion: 2.20 time: 0.177244 Mar 31 18:14:18.991022 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 44/107] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:14:18 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1408 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:14:19.097710 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-5054d5b0-3fbf-4169-b7b9-8f5f3c281073 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:19.107017 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-5054d5b0-3fbf-4169-b7b9-8f5f3c281073 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1321 microversion: 2.1 time: 0.241303 Mar 31 18:14:19.107932 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 64/108] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:18 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1321 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:14:19.381210 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-9f6f4a8d-b80a-40c7-b885-331dbcf0214c tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:19.381856 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-9f6f4a8d-b80a-40c7-b885-331dbcf0214c tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:19.388725 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9f6f4a8d-b80a-40c7-b885-331dbcf0214c tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:19.389101 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9f6f4a8d-b80a-40c7-b885-331dbcf0214c tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:19.389879 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9f6f4a8d-b80a-40c7-b885-331dbcf0214c tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:19.390342 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9f6f4a8d-b80a-40c7-b885-331dbcf0214c tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:19.549353 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-9f6f4a8d-b80a-40c7-b885-331dbcf0214c tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1dacde91404110b259cfab7a37bb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23366fa77e9049af8c183f6959cc158f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:19.561030 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-9f6f4a8d-b80a-40c7-b885-331dbcf0214c tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] 10.222.0.58 "GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e" status: 200 len: 1314 microversion: 2.1 time: 0.183670 Mar 31 18:14:19.570777 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 45/109] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:19 2022] GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:14:20.005953 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-3bdf25df-67f4-46a6-9189-1ee235de8e02 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:20.006646 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-3bdf25df-67f4-46a6-9189-1ee235de8e02 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:20.012832 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3bdf25df-67f4-46a6-9189-1ee235de8e02 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:20.013272 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3bdf25df-67f4-46a6-9189-1ee235de8e02 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:20.014045 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3bdf25df-67f4-46a6-9189-1ee235de8e02 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:20.014472 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3bdf25df-67f4-46a6-9189-1ee235de8e02 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:20.123719 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-74dff60f-debe-4b91-bce2-dc3f0f2a5787 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:20.124324 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-74dff60f-debe-4b91-bce2-dc3f0f2a5787 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:20.131044 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-74dff60f-debe-4b91-bce2-dc3f0f2a5787 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:20.131589 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-74dff60f-debe-4b91-bce2-dc3f0f2a5787 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:20.135375 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-74dff60f-debe-4b91-bce2-dc3f0f2a5787 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:20.135375 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-74dff60f-debe-4b91-bce2-dc3f0f2a5787 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:20.226084 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-3bdf25df-67f4-46a6-9189-1ee235de8e02 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:20.237996 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-3bdf25df-67f4-46a6-9189-1ee235de8e02 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:20.241172 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-3bdf25df-67f4-46a6-9189-1ee235de8e02 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:20.243391 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-3bdf25df-67f4-46a6-9189-1ee235de8e02 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1408 microversion: 2.20 time: 0.242106 Mar 31 18:14:20.244111 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 65/110] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:14:20 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1408 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:14:20.276301 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-74dff60f-debe-4b91-bce2-dc3f0f2a5787 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:20.283441 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-74dff60f-debe-4b91-bce2-dc3f0f2a5787 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1321 microversion: 2.1 time: 0.163485 Mar 31 18:14:20.284342 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 46/111] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:20 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1321 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:20.578001 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-3c1b4dc4-3ff3-4d16-a4c5-f0acbb51779f tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:20.578598 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-3c1b4dc4-3ff3-4d16-a4c5-f0acbb51779f tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:20.584658 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3c1b4dc4-3ff3-4d16-a4c5-f0acbb51779f tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:20.585100 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3c1b4dc4-3ff3-4d16-a4c5-f0acbb51779f tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:20.585860 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3c1b4dc4-3ff3-4d16-a4c5-f0acbb51779f tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:20.586272 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3c1b4dc4-3ff3-4d16-a4c5-f0acbb51779f tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:20.938013 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-3c1b4dc4-3ff3-4d16-a4c5-f0acbb51779f tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1dacde91404110b259cfab7a37bb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23366fa77e9049af8c183f6959cc158f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:20.952517 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-3c1b4dc4-3ff3-4d16-a4c5-f0acbb51779f tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] 10.222.0.58 "GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e" status: 200 len: 1314 microversion: 2.1 time: 0.378216 Mar 31 18:14:20.953542 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 66/112] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:20 2022] GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e => generated 1314 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:21.261211 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-4f384af4-ff23-42f8-b59a-4584896e8308 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:21.261811 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-4f384af4-ff23-42f8-b59a-4584896e8308 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:21.267947 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-4f384af4-ff23-42f8-b59a-4584896e8308 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:21.268735 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-4f384af4-ff23-42f8-b59a-4584896e8308 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:21.270559 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-4f384af4-ff23-42f8-b59a-4584896e8308 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:21.271020 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-4f384af4-ff23-42f8-b59a-4584896e8308 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:21.303056 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-fe84e6a4-ced8-4e1c-b3eb-b69e0c284cd4 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:21.303733 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-fe84e6a4-ced8-4e1c-b3eb-b69e0c284cd4 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:21.309932 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-fe84e6a4-ced8-4e1c-b3eb-b69e0c284cd4 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:21.310372 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-fe84e6a4-ced8-4e1c-b3eb-b69e0c284cd4 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:21.311529 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-fe84e6a4-ced8-4e1c-b3eb-b69e0c284cd4 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:21.315482 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-fe84e6a4-ced8-4e1c-b3eb-b69e0c284cd4 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:21.439460 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-4f384af4-ff23-42f8-b59a-4584896e8308 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:21.452502 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-4f384af4-ff23-42f8-b59a-4584896e8308 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:21.455575 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-4f384af4-ff23-42f8-b59a-4584896e8308 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:21.455575 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-4f384af4-ff23-42f8-b59a-4584896e8308 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1408 microversion: 2.20 time: 0.198081 Mar 31 18:14:21.456085 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 47/113] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:14:21 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1408 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 31 18:14:21.488484 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-fe84e6a4-ced8-4e1c-b3eb-b69e0c284cd4 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:21.496746 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-fe84e6a4-ced8-4e1c-b3eb-b69e0c284cd4 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1321 microversion: 2.1 time: 0.198758 Mar 31 18:14:21.507198 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 67/114] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:21 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1321 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:21.970012 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-1bcd6018-be21-4b26-8478-861e62050a30 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:21.970831 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-1bcd6018-be21-4b26-8478-861e62050a30 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:21.977384 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1bcd6018-be21-4b26-8478-861e62050a30 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:21.977828 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1bcd6018-be21-4b26-8478-861e62050a30 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:21.978591 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1bcd6018-be21-4b26-8478-861e62050a30 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:21.979250 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1bcd6018-be21-4b26-8478-861e62050a30 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:22.186125 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-1bcd6018-be21-4b26-8478-861e62050a30 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1dacde91404110b259cfab7a37bb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23366fa77e9049af8c183f6959cc158f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:22.194891 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-1bcd6018-be21-4b26-8478-861e62050a30 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] 10.222.0.58 "GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e" status: 200 len: 1314 microversion: 2.1 time: 0.228749 Mar 31 18:14:22.195490 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 48/115] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:21 2022] GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e => generated 1314 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:22.474700 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-01060831-660b-4eb7-8c0e-38449c7adcd7 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:22.475309 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-01060831-660b-4eb7-8c0e-38449c7adcd7 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:22.481776 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-01060831-660b-4eb7-8c0e-38449c7adcd7 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:22.482282 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-01060831-660b-4eb7-8c0e-38449c7adcd7 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:22.483116 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-01060831-660b-4eb7-8c0e-38449c7adcd7 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:22.483623 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-01060831-660b-4eb7-8c0e-38449c7adcd7 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:22.515765 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-3f9e914a-5772-4cfe-840e-3176513181c6 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:22.515765 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-3f9e914a-5772-4cfe-840e-3176513181c6 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:22.521239 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3f9e914a-5772-4cfe-840e-3176513181c6 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:22.521708 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3f9e914a-5772-4cfe-840e-3176513181c6 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:22.522821 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3f9e914a-5772-4cfe-840e-3176513181c6 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:22.523643 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3f9e914a-5772-4cfe-840e-3176513181c6 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:22.651020 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-01060831-660b-4eb7-8c0e-38449c7adcd7 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:22.660460 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-01060831-660b-4eb7-8c0e-38449c7adcd7 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:22.662404 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-01060831-660b-4eb7-8c0e-38449c7adcd7 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:22.670742 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-01060831-660b-4eb7-8c0e-38449c7adcd7 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1408 microversion: 2.20 time: 0.194347 Mar 31 18:14:22.670742 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 68/116] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:14:22 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1408 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:14:22.735964 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-3f9e914a-5772-4cfe-840e-3176513181c6 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:22.744338 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-3f9e914a-5772-4cfe-840e-3176513181c6 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1321 microversion: 2.1 time: 0.234547 Mar 31 18:14:22.744912 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 49/117] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:22 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1321 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:23.213466 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-eb1ed925-3447-457a-8687-77bff64f32f4 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:23.214204 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-eb1ed925-3447-457a-8687-77bff64f32f4 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:23.225938 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-eb1ed925-3447-457a-8687-77bff64f32f4 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:23.225938 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-eb1ed925-3447-457a-8687-77bff64f32f4 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:23.225938 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-eb1ed925-3447-457a-8687-77bff64f32f4 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:23.225938 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-eb1ed925-3447-457a-8687-77bff64f32f4 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:23.381062 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-eb1ed925-3447-457a-8687-77bff64f32f4 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1dacde91404110b259cfab7a37bb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23366fa77e9049af8c183f6959cc158f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:23.388397 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-eb1ed925-3447-457a-8687-77bff64f32f4 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] 10.222.0.58 "GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e" status: 200 len: 1314 microversion: 2.1 time: 0.178816 Mar 31 18:14:23.389040 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 69/118] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:23 2022] GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:23.682351 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-e594f6c6-52bd-4a64-ab2e-0e6c30318ca1 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:23.682985 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-e594f6c6-52bd-4a64-ab2e-0e6c30318ca1 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:23.688860 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e594f6c6-52bd-4a64-ab2e-0e6c30318ca1 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:23.689301 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e594f6c6-52bd-4a64-ab2e-0e6c30318ca1 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:23.690050 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e594f6c6-52bd-4a64-ab2e-0e6c30318ca1 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:23.692146 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e594f6c6-52bd-4a64-ab2e-0e6c30318ca1 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:23.769206 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-8382c287-19ec-4915-bdff-2a0e06df3c0f tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:23.770715 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-8382c287-19ec-4915-bdff-2a0e06df3c0f tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:23.778568 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8382c287-19ec-4915-bdff-2a0e06df3c0f tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:23.784282 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8382c287-19ec-4915-bdff-2a0e06df3c0f tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:23.784282 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8382c287-19ec-4915-bdff-2a0e06df3c0f tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:23.784282 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8382c287-19ec-4915-bdff-2a0e06df3c0f tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:23.889392 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-e594f6c6-52bd-4a64-ab2e-0e6c30318ca1 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:23.907642 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-e594f6c6-52bd-4a64-ab2e-0e6c30318ca1 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:23.913142 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-e594f6c6-52bd-4a64-ab2e-0e6c30318ca1 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:23.919065 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-e594f6c6-52bd-4a64-ab2e-0e6c30318ca1 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1408 microversion: 2.20 time: 0.236693 Mar 31 18:14:23.921031 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 50/119] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:14:23 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1408 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:14:23.989552 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-8382c287-19ec-4915-bdff-2a0e06df3c0f tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:23.999021 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-8382c287-19ec-4915-bdff-2a0e06df3c0f tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1321 microversion: 2.1 time: 0.234081 Mar 31 18:14:24.011766 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 70/120] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:23 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1321 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:24.406775 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-f041db4e-090c-4fa7-a540-15c457f56892 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:24.407593 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-f041db4e-090c-4fa7-a540-15c457f56892 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:24.413715 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-f041db4e-090c-4fa7-a540-15c457f56892 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:24.414224 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-f041db4e-090c-4fa7-a540-15c457f56892 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:24.415035 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-f041db4e-090c-4fa7-a540-15c457f56892 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:24.419856 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-f041db4e-090c-4fa7-a540-15c457f56892 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:24.557557 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-f041db4e-090c-4fa7-a540-15c457f56892 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1dacde91404110b259cfab7a37bb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23366fa77e9049af8c183f6959cc158f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:24.566496 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-f041db4e-090c-4fa7-a540-15c457f56892 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] 10.222.0.58 "GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e" status: 200 len: 1314 microversion: 2.1 time: 0.164657 Mar 31 18:14:24.567910 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 51/121] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:24 2022] GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:24.936394 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-a5e0aa5a-c806-48e4-99f9-87bc6892eb78 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:24.936950 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-a5e0aa5a-c806-48e4-99f9-87bc6892eb78 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:24.942960 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a5e0aa5a-c806-48e4-99f9-87bc6892eb78 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:24.943414 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a5e0aa5a-c806-48e4-99f9-87bc6892eb78 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:24.944185 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a5e0aa5a-c806-48e4-99f9-87bc6892eb78 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:24.944618 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a5e0aa5a-c806-48e4-99f9-87bc6892eb78 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:25.019884 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-f79f9b2e-3dae-4176-91bf-970300bd1bcd tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:25.020622 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-f79f9b2e-3dae-4176-91bf-970300bd1bcd tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:25.035191 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-f79f9b2e-3dae-4176-91bf-970300bd1bcd tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:25.035767 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-f79f9b2e-3dae-4176-91bf-970300bd1bcd tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:25.044126 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-f79f9b2e-3dae-4176-91bf-970300bd1bcd tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:25.044591 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-f79f9b2e-3dae-4176-91bf-970300bd1bcd tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:25.177272 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-a5e0aa5a-c806-48e4-99f9-87bc6892eb78 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:25.188404 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-a5e0aa5a-c806-48e4-99f9-87bc6892eb78 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:25.188944 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-a5e0aa5a-c806-48e4-99f9-87bc6892eb78 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:25.190139 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-a5e0aa5a-c806-48e4-99f9-87bc6892eb78 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1408 microversion: 2.20 time: 0.258081 Mar 31 18:14:25.191571 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 71/122] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:14:24 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1408 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:14:25.282008 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-f79f9b2e-3dae-4176-91bf-970300bd1bcd tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:25.304997 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-f79f9b2e-3dae-4176-91bf-970300bd1bcd tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1321 microversion: 2.1 time: 0.290089 Mar 31 18:14:25.314131 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 52/123] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:25 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1321 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:25.585867 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-b0722bfd-1c1c-4d9a-80ca-197869963d5f tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:25.586470 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-b0722bfd-1c1c-4d9a-80ca-197869963d5f tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:25.593134 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b0722bfd-1c1c-4d9a-80ca-197869963d5f tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:25.593715 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b0722bfd-1c1c-4d9a-80ca-197869963d5f tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:25.594512 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b0722bfd-1c1c-4d9a-80ca-197869963d5f tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:25.594982 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b0722bfd-1c1c-4d9a-80ca-197869963d5f tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:25.736031 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-b0722bfd-1c1c-4d9a-80ca-197869963d5f tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1dacde91404110b259cfab7a37bb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23366fa77e9049af8c183f6959cc158f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:25.746111 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-b0722bfd-1c1c-4d9a-80ca-197869963d5f tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] 10.222.0.58 "GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e" status: 200 len: 1314 microversion: 2.1 time: 0.164037 Mar 31 18:14:25.746571 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 72/124] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:25 2022] GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:26.212821 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-1b7f9815-9e19-47c4-be8c-6f4031fc3037 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:26.213966 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-1b7f9815-9e19-47c4-be8c-6f4031fc3037 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:26.224708 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1b7f9815-9e19-47c4-be8c-6f4031fc3037 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:26.225732 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1b7f9815-9e19-47c4-be8c-6f4031fc3037 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:26.229600 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1b7f9815-9e19-47c4-be8c-6f4031fc3037 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:26.229600 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1b7f9815-9e19-47c4-be8c-6f4031fc3037 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:26.321851 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-bed92395-deed-4bef-a76d-0c760c715b98 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:26.322722 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-bed92395-deed-4bef-a76d-0c760c715b98 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:26.334410 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-bed92395-deed-4bef-a76d-0c760c715b98 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:26.334969 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-bed92395-deed-4bef-a76d-0c760c715b98 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:26.335783 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-bed92395-deed-4bef-a76d-0c760c715b98 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:26.336218 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-bed92395-deed-4bef-a76d-0c760c715b98 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:26.427512 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-1b7f9815-9e19-47c4-be8c-6f4031fc3037 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:26.454419 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-1b7f9815-9e19-47c4-be8c-6f4031fc3037 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:26.454419 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-1b7f9815-9e19-47c4-be8c-6f4031fc3037 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:26.455723 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-1b7f9815-9e19-47c4-be8c-6f4031fc3037 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1408 microversion: 2.20 time: 0.249827 Mar 31 18:14:26.457159 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 53/125] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:14:26 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1408 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:14:26.583967 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-bed92395-deed-4bef-a76d-0c760c715b98 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:26.591477 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-bed92395-deed-4bef-a76d-0c760c715b98 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1321 microversion: 2.1 time: 0.273333 Mar 31 18:14:26.592018 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 73/126] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:26 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1321 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:14:26.762344 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-4e2bf8a4-496d-4fee-9152-e52a71c469a8 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:26.762981 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-4e2bf8a4-496d-4fee-9152-e52a71c469a8 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:26.768918 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-4e2bf8a4-496d-4fee-9152-e52a71c469a8 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:26.769354 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-4e2bf8a4-496d-4fee-9152-e52a71c469a8 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:26.770109 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-4e2bf8a4-496d-4fee-9152-e52a71c469a8 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:26.770530 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-4e2bf8a4-496d-4fee-9152-e52a71c469a8 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:26.909394 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-4e2bf8a4-496d-4fee-9152-e52a71c469a8 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1dacde91404110b259cfab7a37bb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23366fa77e9049af8c183f6959cc158f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:26.917407 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-4e2bf8a4-496d-4fee-9152-e52a71c469a8 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] 10.222.0.58 "GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e" status: 200 len: 1314 microversion: 2.1 time: 0.158821 Mar 31 18:14:26.917998 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 54/127] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:26 2022] GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:27.481655 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-d890344f-7868-4a17-8b67-2f4eccd46950 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:27.483667 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-d890344f-7868-4a17-8b67-2f4eccd46950 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:27.495365 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-d890344f-7868-4a17-8b67-2f4eccd46950 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:27.496797 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-d890344f-7868-4a17-8b67-2f4eccd46950 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:27.499119 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-d890344f-7868-4a17-8b67-2f4eccd46950 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:27.500108 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-d890344f-7868-4a17-8b67-2f4eccd46950 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:27.609447 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-b05f12d8-fc86-4be5-bee0-51d286e97bf3 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:27.610048 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-b05f12d8-fc86-4be5-bee0-51d286e97bf3 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:27.618106 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b05f12d8-fc86-4be5-bee0-51d286e97bf3 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:27.627946 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b05f12d8-fc86-4be5-bee0-51d286e97bf3 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:27.627946 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b05f12d8-fc86-4be5-bee0-51d286e97bf3 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:27.627946 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b05f12d8-fc86-4be5-bee0-51d286e97bf3 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:27.728088 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-d890344f-7868-4a17-8b67-2f4eccd46950 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:27.738056 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-d890344f-7868-4a17-8b67-2f4eccd46950 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:27.738912 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-d890344f-7868-4a17-8b67-2f4eccd46950 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:27.740040 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-d890344f-7868-4a17-8b67-2f4eccd46950 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1408 microversion: 2.20 time: 0.266044 Mar 31 18:14:27.740895 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 74/128] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:14:27 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1408 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:14:27.893629 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-b05f12d8-fc86-4be5-bee0-51d286e97bf3 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:27.897130 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [req-d3e5ea41-bc54-4459-92a4-879c78e495d1 req-9aa80a12-135e-49f5-b374-a47752a23f73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62ef59ed-5ec0-4452-9708-184340fa4f7f", "name": "network-vif-plugged", "status": "completed", "tag": "9426b740-3eca-421b-a5c0-b9ab2601eebd"}]} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:14:27.912150 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-b05f12d8-fc86-4be5-bee0-51d286e97bf3 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1321 microversion: 2.1 time: 0.305238 Mar 31 18:14:27.914680 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 55/129] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:27 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1321 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:27.920569 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-d3e5ea41-bc54-4459-92a4-879c78e495d1 req-9aa80a12-135e-49f5-b374-a47752a23f73 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:27.921380 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-d3e5ea41-bc54-4459-92a4-879c78e495d1 req-9aa80a12-135e-49f5-b374-a47752a23f73 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:27.935429 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-1915896f-0b4d-48da-83b4-61f6a1372298 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:27.936326 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-1915896f-0b4d-48da-83b4-61f6a1372298 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:27.949757 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1915896f-0b4d-48da-83b4-61f6a1372298 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:27.957573 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1915896f-0b4d-48da-83b4-61f6a1372298 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:27.957573 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1915896f-0b4d-48da-83b4-61f6a1372298 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:27.957573 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1915896f-0b4d-48da-83b4-61f6a1372298 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:27.968759 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.compute.server_external_events [req-d3e5ea41-bc54-4459-92a4-879c78e495d1 req-9aa80a12-135e-49f5-b374-a47752a23f73 service nova] Creating event network-vif-plugged:9426b740-3eca-421b-a5c0-b9ab2601eebd for instance 62ef59ed-5ec0-4452-9708-184340fa4f7f on hv-cinder-maste Mar 31 18:14:27.969614 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-d3e5ea41-bc54-4459-92a4-879c78e495d1 req-9aa80a12-135e-49f5-b374-a47752a23f73 service nova] Acquired lock "compute-rpcapi-router" {{(pid=117538) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Mar 31 18:14:27.972230 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-453078bc-8d06-4909-9f2f-5352ad7e6088 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:27.972904 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-453078bc-8d06-4909-9f2f-5352ad7e6088 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:27.973999 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-453078bc-8d06-4909-9f2f-5352ad7e6088 None None] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:27.975264 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-453078bc-8d06-4909-9f2f-5352ad7e6088 None None] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:27.986648 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.compute.rpcapi [None req-453078bc-8d06-4909-9f2f-5352ad7e6088 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Mar 31 18:14:27.987847 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-453078bc-8d06-4909-9f2f-5352ad7e6088 None None] Releasing lock "compute-rpcapi-router" {{(pid=117538) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Mar 31 18:14:28.015486 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-453078bc-8d06-4909-9f2f-5352ad7e6088 None None] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.273237 Mar 31 18:14:28.016138 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 75/130] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:14:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:14:28.201687 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-1915896f-0b4d-48da-83b4-61f6a1372298 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1dacde91404110b259cfab7a37bb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23366fa77e9049af8c183f6959cc158f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:28.210484 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-1915896f-0b4d-48da-83b4-61f6a1372298 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] 10.222.0.58 "GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e" status: 200 len: 1314 microversion: 2.1 time: 0.279459 Mar 31 18:14:28.211472 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 56/131] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:27 2022] GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e => generated 1314 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:14:28.758525 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-61e17fa2-42d6-4ac6-b528-2779b68577a6 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:28.759605 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-61e17fa2-42d6-4ac6-b528-2779b68577a6 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:28.772097 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-61e17fa2-42d6-4ac6-b528-2779b68577a6 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:28.772698 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-61e17fa2-42d6-4ac6-b528-2779b68577a6 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:28.773607 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-61e17fa2-42d6-4ac6-b528-2779b68577a6 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:28.774145 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-61e17fa2-42d6-4ac6-b528-2779b68577a6 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:28.928809 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-702ee8c6-d99b-4d31-bdfa-a94c10bc895d tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:28.929508 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-702ee8c6-d99b-4d31-bdfa-a94c10bc895d tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:28.935313 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-702ee8c6-d99b-4d31-bdfa-a94c10bc895d tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:28.935774 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-702ee8c6-d99b-4d31-bdfa-a94c10bc895d tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:28.936535 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-702ee8c6-d99b-4d31-bdfa-a94c10bc895d tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:28.936959 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-702ee8c6-d99b-4d31-bdfa-a94c10bc895d tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:28.974823 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-61e17fa2-42d6-4ac6-b528-2779b68577a6 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:28.997236 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-61e17fa2-42d6-4ac6-b528-2779b68577a6 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:29.000195 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-61e17fa2-42d6-4ac6-b528-2779b68577a6 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:29.006075 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-61e17fa2-42d6-4ac6-b528-2779b68577a6 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1408 microversion: 2.20 time: 0.247700 Mar 31 18:14:29.006075 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 76/132] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:14:28 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1408 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:14:29.098720 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-702ee8c6-d99b-4d31-bdfa-a94c10bc895d tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:29.106451 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-702ee8c6-d99b-4d31-bdfa-a94c10bc895d tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1321 microversion: 2.1 time: 0.182620 Mar 31 18:14:29.107095 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 57/133] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:28 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1321 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:14:29.227522 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-47e994eb-328c-405e-878a-04a1155f93b7 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:29.228082 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-47e994eb-328c-405e-878a-04a1155f93b7 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:29.234136 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-47e994eb-328c-405e-878a-04a1155f93b7 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:29.234578 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-47e994eb-328c-405e-878a-04a1155f93b7 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:29.235373 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-47e994eb-328c-405e-878a-04a1155f93b7 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:29.235800 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-47e994eb-328c-405e-878a-04a1155f93b7 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:29.427859 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-47e994eb-328c-405e-878a-04a1155f93b7 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1dacde91404110b259cfab7a37bb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23366fa77e9049af8c183f6959cc158f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:29.437724 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-47e994eb-328c-405e-878a-04a1155f93b7 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] 10.222.0.58 "GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e" status: 200 len: 1314 microversion: 2.1 time: 0.214001 Mar 31 18:14:29.448220 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 77/134] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:29 2022] GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e => generated 1314 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:30.021977 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-433e5bd9-4f27-4bf9-8f18-4fb87067cb2a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:30.022481 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-433e5bd9-4f27-4bf9-8f18-4fb87067cb2a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:30.032111 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [req-0b0d1611-80e4-4dfb-bfc1-69d66feefdd0 req-896f80fd-b8db-4c6a-b12f-0dd85415edbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "779c13cd-7a7a-47b4-b488-0d1e365c3dc4", "name": "network-vif-plugged", "status": "completed", "tag": "a16d9c5f-04bd-414b-a468-f0a9a47b917b"}, {"server_uuid": "b4a8079a-7824-4201-889b-a14d70024f7e", "name": "network-vif-plugged", "status": "completed", "tag": "b41ca13e-f9fc-4896-a18b-4d8b90a0ef6b"}]} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:14:30.033917 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-433e5bd9-4f27-4bf9-8f18-4fb87067cb2a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:30.033917 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-433e5bd9-4f27-4bf9-8f18-4fb87067cb2a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:30.033917 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-433e5bd9-4f27-4bf9-8f18-4fb87067cb2a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:30.037269 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-433e5bd9-4f27-4bf9-8f18-4fb87067cb2a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:30.043914 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-0b0d1611-80e4-4dfb-bfc1-69d66feefdd0 req-896f80fd-b8db-4c6a-b12f-0dd85415edbc service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:30.045843 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-0b0d1611-80e4-4dfb-bfc1-69d66feefdd0 req-896f80fd-b8db-4c6a-b12f-0dd85415edbc service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:30.065580 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.compute.server_external_events [req-0b0d1611-80e4-4dfb-bfc1-69d66feefdd0 req-896f80fd-b8db-4c6a-b12f-0dd85415edbc service nova] Creating event network-vif-plugged:a16d9c5f-04bd-414b-a468-f0a9a47b917b for instance 779c13cd-7a7a-47b4-b488-0d1e365c3dc4 on hv-cinder-maste Mar 31 18:14:30.066190 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.compute.server_external_events [req-0b0d1611-80e4-4dfb-bfc1-69d66feefdd0 req-896f80fd-b8db-4c6a-b12f-0dd85415edbc service nova] Creating event network-vif-plugged:b41ca13e-f9fc-4896-a18b-4d8b90a0ef6b for instance b4a8079a-7824-4201-889b-a14d70024f7e on hv-cinder-maste Mar 31 18:14:30.072994 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [req-0b0d1611-80e4-4dfb-bfc1-69d66feefdd0 req-896f80fd-b8db-4c6a-b12f-0dd85415edbc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.045299 Mar 31 18:14:30.073697 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 78/135] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 31 18:14:30.124648 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-fb205045-e8db-4a8c-8925-8f89617445a1 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:30.125257 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-fb205045-e8db-4a8c-8925-8f89617445a1 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:30.131705 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-fb205045-e8db-4a8c-8925-8f89617445a1 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:30.132158 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-fb205045-e8db-4a8c-8925-8f89617445a1 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:30.132919 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-fb205045-e8db-4a8c-8925-8f89617445a1 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:30.133371 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-fb205045-e8db-4a8c-8925-8f89617445a1 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:30.183148 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-433e5bd9-4f27-4bf9-8f18-4fb87067cb2a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:30.206524 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-433e5bd9-4f27-4bf9-8f18-4fb87067cb2a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:30.209328 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-433e5bd9-4f27-4bf9-8f18-4fb87067cb2a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:30.214273 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-433e5bd9-4f27-4bf9-8f18-4fb87067cb2a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1408 microversion: 2.20 time: 0.196359 Mar 31 18:14:30.227475 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 58/136] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:14:30 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1408 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:14:30.280760 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-fb205045-e8db-4a8c-8925-8f89617445a1 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:30.289620 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-fb205045-e8db-4a8c-8925-8f89617445a1 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1321 microversion: 2.1 time: 0.169256 Mar 31 18:14:30.290456 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 79/137] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:30 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:14:30.456405 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-a1de77bb-d2eb-4256-bfe2-c2027756ef0b tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:30.457017 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-a1de77bb-d2eb-4256-bfe2-c2027756ef0b tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:30.463527 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a1de77bb-d2eb-4256-bfe2-c2027756ef0b tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:30.464449 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a1de77bb-d2eb-4256-bfe2-c2027756ef0b tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:30.465384 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a1de77bb-d2eb-4256-bfe2-c2027756ef0b tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:30.465994 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a1de77bb-d2eb-4256-bfe2-c2027756ef0b tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:30.681140 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-a1de77bb-d2eb-4256-bfe2-c2027756ef0b tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1dacde91404110b259cfab7a37bb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23366fa77e9049af8c183f6959cc158f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:30.690379 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-a1de77bb-d2eb-4256-bfe2-c2027756ef0b tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] 10.222.0.58 "GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e" status: 200 len: 1314 microversion: 2.1 time: 0.238158 Mar 31 18:14:30.697276 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 59/138] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:30 2022] GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e => generated 1314 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:31.235348 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-030dddb9-8ec7-43ad-8ff8-c54802b53234 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:31.236851 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-030dddb9-8ec7-43ad-8ff8-c54802b53234 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:31.246772 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-030dddb9-8ec7-43ad-8ff8-c54802b53234 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:31.247424 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-030dddb9-8ec7-43ad-8ff8-c54802b53234 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:31.249093 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-030dddb9-8ec7-43ad-8ff8-c54802b53234 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:31.251017 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-030dddb9-8ec7-43ad-8ff8-c54802b53234 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:31.308409 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-aa429e18-81d8-490e-bec4-b778780414f5 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:31.309189 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-aa429e18-81d8-490e-bec4-b778780414f5 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:31.316293 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-aa429e18-81d8-490e-bec4-b778780414f5 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:31.316897 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-aa429e18-81d8-490e-bec4-b778780414f5 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:31.317907 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-aa429e18-81d8-490e-bec4-b778780414f5 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:31.318598 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-aa429e18-81d8-490e-bec4-b778780414f5 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:31.447452 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-030dddb9-8ec7-43ad-8ff8-c54802b53234 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:31.456467 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-030dddb9-8ec7-43ad-8ff8-c54802b53234 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:31.458016 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-030dddb9-8ec7-43ad-8ff8-c54802b53234 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:31.461200 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-aa429e18-81d8-490e-bec4-b778780414f5 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:31.467748 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-030dddb9-8ec7-43ad-8ff8-c54802b53234 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1408 microversion: 2.20 time: 0.235046 Mar 31 18:14:31.469392 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 80/139] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:14:31 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1408 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:14:31.475854 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-aa429e18-81d8-490e-bec4-b778780414f5 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1321 microversion: 2.1 time: 0.171299 Mar 31 18:14:31.477389 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 60/140] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:31 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:31.713264 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-b67816ac-e6cb-4026-a560-2fec6a0b5a7d tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:31.713822 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-b67816ac-e6cb-4026-a560-2fec6a0b5a7d tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:31.719777 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b67816ac-e6cb-4026-a560-2fec6a0b5a7d tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:31.720295 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b67816ac-e6cb-4026-a560-2fec6a0b5a7d tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:31.721201 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b67816ac-e6cb-4026-a560-2fec6a0b5a7d tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:31.721625 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b67816ac-e6cb-4026-a560-2fec6a0b5a7d tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:31.873977 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-b67816ac-e6cb-4026-a560-2fec6a0b5a7d tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1dacde91404110b259cfab7a37bb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23366fa77e9049af8c183f6959cc158f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:31.881380 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-b67816ac-e6cb-4026-a560-2fec6a0b5a7d tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] 10.222.0.58 "GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e" status: 200 len: 1314 microversion: 2.1 time: 0.172023 Mar 31 18:14:31.881956 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 81/141] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:31 2022] GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:14:32.090454 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [req-2278743c-16da-40f4-9c3d-cda80b0cfb34 req-ef571913-148c-4e01-85bd-a334605b1cf7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0", "name": "network-vif-plugged", "status": "completed", "tag": "3bfd294a-f954-4562-8fbf-0cd104ab3bee"}]} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:14:32.099157 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-2278743c-16da-40f4-9c3d-cda80b0cfb34 req-ef571913-148c-4e01-85bd-a334605b1cf7 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:32.099599 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-2278743c-16da-40f4-9c3d-cda80b0cfb34 req-ef571913-148c-4e01-85bd-a334605b1cf7 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:32.111032 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.compute.server_external_events [req-2278743c-16da-40f4-9c3d-cda80b0cfb34 req-ef571913-148c-4e01-85bd-a334605b1cf7 service nova] Creating event network-vif-plugged:3bfd294a-f954-4562-8fbf-0cd104ab3bee for instance 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 on hv-cinder-maste Mar 31 18:14:32.116601 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [req-2278743c-16da-40f4-9c3d-cda80b0cfb34 req-ef571913-148c-4e01-85bd-a334605b1cf7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030316 Mar 31 18:14:32.117205 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 61/142] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:14:32.492106 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-831960df-3a19-4b47-b6b2-2ca911511cf7 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:32.492831 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-831960df-3a19-4b47-b6b2-2ca911511cf7 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:32.498410 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-afc87dda-18e7-4ba6-8da7-8ec32268f049 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:32.498855 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-831960df-3a19-4b47-b6b2-2ca911511cf7 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:32.499142 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-831960df-3a19-4b47-b6b2-2ca911511cf7 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:32.499808 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-afc87dda-18e7-4ba6-8da7-8ec32268f049 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:32.500281 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-831960df-3a19-4b47-b6b2-2ca911511cf7 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:32.500718 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-831960df-3a19-4b47-b6b2-2ca911511cf7 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:32.508769 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-afc87dda-18e7-4ba6-8da7-8ec32268f049 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:32.509453 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-afc87dda-18e7-4ba6-8da7-8ec32268f049 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:32.510756 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-afc87dda-18e7-4ba6-8da7-8ec32268f049 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:32.511342 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-afc87dda-18e7-4ba6-8da7-8ec32268f049 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:32.681062 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-afc87dda-18e7-4ba6-8da7-8ec32268f049 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:32.691280 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-afc87dda-18e7-4ba6-8da7-8ec32268f049 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1321 microversion: 2.1 time: 0.199689 Mar 31 18:14:32.700533 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 62/143] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:32 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1321 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:32.701247 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-831960df-3a19-4b47-b6b2-2ca911511cf7 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:32.711170 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-831960df-3a19-4b47-b6b2-2ca911511cf7 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:32.712693 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-831960df-3a19-4b47-b6b2-2ca911511cf7 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:32.713792 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-831960df-3a19-4b47-b6b2-2ca911511cf7 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1408 microversion: 2.20 time: 0.228535 Mar 31 18:14:32.714515 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 82/144] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:14:32 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1408 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:14:32.897167 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-6f9e7249-67d4-47e9-a241-e93e1e7fc3e0 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:32.897885 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-6f9e7249-67d4-47e9-a241-e93e1e7fc3e0 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:32.903894 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-6f9e7249-67d4-47e9-a241-e93e1e7fc3e0 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:32.904448 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-6f9e7249-67d4-47e9-a241-e93e1e7fc3e0 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:32.905205 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-6f9e7249-67d4-47e9-a241-e93e1e7fc3e0 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:32.905627 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-6f9e7249-67d4-47e9-a241-e93e1e7fc3e0 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:33.050791 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-6f9e7249-67d4-47e9-a241-e93e1e7fc3e0 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1dacde91404110b259cfab7a37bb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23366fa77e9049af8c183f6959cc158f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:33.068049 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-6f9e7249-67d4-47e9-a241-e93e1e7fc3e0 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] 10.222.0.58 "GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e" status: 200 len: 1314 microversion: 2.1 time: 0.174595 Mar 31 18:14:33.068882 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 63/145] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:32 2022] GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:33.708527 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-59155829-3b0b-4baf-b7ce-b0605853a357 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:33.709136 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-59155829-3b0b-4baf-b7ce-b0605853a357 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:33.715506 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-59155829-3b0b-4baf-b7ce-b0605853a357 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:33.716457 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-59155829-3b0b-4baf-b7ce-b0605853a357 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:33.717222 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-59155829-3b0b-4baf-b7ce-b0605853a357 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:33.717645 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-59155829-3b0b-4baf-b7ce-b0605853a357 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:33.733329 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-539c8864-1774-44de-8b84-6ff876439eb8 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:33.734491 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-539c8864-1774-44de-8b84-6ff876439eb8 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:33.740660 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-539c8864-1774-44de-8b84-6ff876439eb8 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:33.741290 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-539c8864-1774-44de-8b84-6ff876439eb8 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:33.742194 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-539c8864-1774-44de-8b84-6ff876439eb8 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:33.742802 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-539c8864-1774-44de-8b84-6ff876439eb8 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:33.898358 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-539c8864-1774-44de-8b84-6ff876439eb8 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:33.906493 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-539c8864-1774-44de-8b84-6ff876439eb8 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:33.908424 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-539c8864-1774-44de-8b84-6ff876439eb8 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:33.909568 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-539c8864-1774-44de-8b84-6ff876439eb8 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1408 microversion: 2.20 time: 0.180157 Mar 31 18:14:33.910307 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 64/146] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:14:33 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1408 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:14:33.929138 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-59155829-3b0b-4baf-b7ce-b0605853a357 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:33.936405 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-59155829-3b0b-4baf-b7ce-b0605853a357 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1321 microversion: 2.1 time: 0.232547 Mar 31 18:14:33.936967 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 83/147] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:33 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1321 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:34.084686 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-a1045417-c051-4d8a-bcbd-e76bc72e9ba0 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:34.085311 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-a1045417-c051-4d8a-bcbd-e76bc72e9ba0 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:34.091116 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a1045417-c051-4d8a-bcbd-e76bc72e9ba0 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:34.091550 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a1045417-c051-4d8a-bcbd-e76bc72e9ba0 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:34.092306 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a1045417-c051-4d8a-bcbd-e76bc72e9ba0 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:34.092725 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a1045417-c051-4d8a-bcbd-e76bc72e9ba0 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:34.293459 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-a1045417-c051-4d8a-bcbd-e76bc72e9ba0 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1dacde91404110b259cfab7a37bb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23366fa77e9049af8c183f6959cc158f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:34.300873 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-a1045417-c051-4d8a-bcbd-e76bc72e9ba0 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] 10.222.0.58 "GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e" status: 200 len: 1314 microversion: 2.1 time: 0.220302 Mar 31 18:14:34.301443 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 65/148] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:34 2022] GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e => generated 1314 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:34.930024 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-173a65ba-d9e6-44ca-a4f1-1c82442ebac3 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:34.930654 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-173a65ba-d9e6-44ca-a4f1-1c82442ebac3 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:34.937314 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-173a65ba-d9e6-44ca-a4f1-1c82442ebac3 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:34.937794 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-173a65ba-d9e6-44ca-a4f1-1c82442ebac3 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:34.938689 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-173a65ba-d9e6-44ca-a4f1-1c82442ebac3 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:34.939482 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-173a65ba-d9e6-44ca-a4f1-1c82442ebac3 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:34.953263 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-07de2dc6-c8a9-4a05-ad80-d4092b157f1d tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:34.955162 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-07de2dc6-c8a9-4a05-ad80-d4092b157f1d tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:34.961362 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-07de2dc6-c8a9-4a05-ad80-d4092b157f1d tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:34.962012 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-07de2dc6-c8a9-4a05-ad80-d4092b157f1d tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:34.962828 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-07de2dc6-c8a9-4a05-ad80-d4092b157f1d tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:34.963406 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-07de2dc6-c8a9-4a05-ad80-d4092b157f1d tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:35.103295 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-173a65ba-d9e6-44ca-a4f1-1c82442ebac3 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:35.111735 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-173a65ba-d9e6-44ca-a4f1-1c82442ebac3 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:35.113216 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-173a65ba-d9e6-44ca-a4f1-1c82442ebac3 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:35.114310 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-173a65ba-d9e6-44ca-a4f1-1c82442ebac3 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1408 microversion: 2.20 time: 0.188579 Mar 31 18:14:35.124553 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 84/149] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:14:34 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1408 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:14:35.192436 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-07de2dc6-c8a9-4a05-ad80-d4092b157f1d tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:35.202170 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-07de2dc6-c8a9-4a05-ad80-d4092b157f1d tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1321 microversion: 2.1 time: 0.252581 Mar 31 18:14:35.203000 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 66/150] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:34 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1321 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:35.317305 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-53bd67e5-3cbd-48d7-b9cc-bc9c04002688 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:35.317912 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-53bd67e5-3cbd-48d7-b9cc-bc9c04002688 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:35.324036 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-53bd67e5-3cbd-48d7-b9cc-bc9c04002688 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:35.324478 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-53bd67e5-3cbd-48d7-b9cc-bc9c04002688 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:35.325237 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-53bd67e5-3cbd-48d7-b9cc-bc9c04002688 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:35.325664 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-53bd67e5-3cbd-48d7-b9cc-bc9c04002688 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:35.480086 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-53bd67e5-3cbd-48d7-b9cc-bc9c04002688 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1dacde91404110b259cfab7a37bb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23366fa77e9049af8c183f6959cc158f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:35.493285 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-53bd67e5-3cbd-48d7-b9cc-bc9c04002688 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] 10.222.0.58 "GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e" status: 200 len: 1314 microversion: 2.1 time: 0.179450 Mar 31 18:14:35.494986 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 85/151] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:35 2022] GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:36.132519 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-4d9d524e-4862-43e3-9002-72df5c4f7dd2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:36.133375 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-4d9d524e-4862-43e3-9002-72df5c4f7dd2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:36.143245 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-4d9d524e-4862-43e3-9002-72df5c4f7dd2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:36.143880 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-4d9d524e-4862-43e3-9002-72df5c4f7dd2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:36.144657 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-4d9d524e-4862-43e3-9002-72df5c4f7dd2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:36.145085 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-4d9d524e-4862-43e3-9002-72df5c4f7dd2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:36.222429 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-c623a503-bddf-4384-9f7c-85c2f5980132 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:36.223027 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-c623a503-bddf-4384-9f7c-85c2f5980132 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:36.228817 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c623a503-bddf-4384-9f7c-85c2f5980132 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:36.229269 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c623a503-bddf-4384-9f7c-85c2f5980132 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:36.230042 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c623a503-bddf-4384-9f7c-85c2f5980132 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:36.230483 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c623a503-bddf-4384-9f7c-85c2f5980132 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:36.379834 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-c623a503-bddf-4384-9f7c-85c2f5980132 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:36.388932 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-c623a503-bddf-4384-9f7c-85c2f5980132 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1515 microversion: 2.1 time: 0.172099 Mar 31 18:14:36.389779 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 86/152] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:36 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1515 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:14:36.409068 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-e09df216-0ca9-43fa-915c-2b6b20384f04 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:14:36.410351 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-e09df216-0ca9-43fa-915c-2b6b20384f04 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:36.426136 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e09df216-0ca9-43fa-915c-2b6b20384f04 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:36.426136 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e09df216-0ca9-43fa-915c-2b6b20384f04 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:36.426136 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e09df216-0ca9-43fa-915c-2b6b20384f04 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:36.426136 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e09df216-0ca9-43fa-915c-2b6b20384f04 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:36.517007 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.objects.instance [None req-e09df216-0ca9-43fa-915c-2b6b20384f04 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lazy-loading 'flavor' on Instance uuid 62ef59ed-5ec0-4452-9708-184340fa4f7f {{(pid=117538) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 31 18:14:36.550843 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-4d9d524e-4862-43e3-9002-72df5c4f7dd2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:36.563967 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-4d9d524e-4862-43e3-9002-72df5c4f7dd2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:36.567547 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-4d9d524e-4862-43e3-9002-72df5c4f7dd2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:36.567547 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-4d9d524e-4862-43e3-9002-72df5c4f7dd2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1408 microversion: 2.20 time: 0.438331 Mar 31 18:14:36.568657 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 67/153] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:14:36 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1408 bytes in 440 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:14:36.574230 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-fd1d2ead-4022-4e07-bdd4-3044305f07cd tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:36.575224 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-fd1d2ead-4022-4e07-bdd4-3044305f07cd tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:36.581969 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-fd1d2ead-4022-4e07-bdd4-3044305f07cd tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:36.582545 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-fd1d2ead-4022-4e07-bdd4-3044305f07cd tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:36.583435 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-fd1d2ead-4022-4e07-bdd4-3044305f07cd tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:36.583977 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-fd1d2ead-4022-4e07-bdd4-3044305f07cd tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:36.722586 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-fd1d2ead-4022-4e07-bdd4-3044305f07cd tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1dacde91404110b259cfab7a37bb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23366fa77e9049af8c183f6959cc158f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:36.729834 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-fd1d2ead-4022-4e07-bdd4-3044305f07cd tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] 10.222.0.58 "GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e" status: 200 len: 1314 microversion: 2.1 time: 0.159954 Mar 31 18:14:36.730340 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 68/154] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:36 2022] GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:37.082045 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-e09df216-0ca9-43fa-915c-2b6b20384f04 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "POST /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f/action" status: 200 len: 32 microversion: 2.1 time: 0.678982 Mar 31 18:14:37.087413 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 87/155] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Mar 31 18:14:36 2022] POST /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f/action => generated 32 bytes in 681 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 31 18:14:37.091891 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-1e555f11-5008-4dae-b74c-d8305f10623e tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:37.092493 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-1e555f11-5008-4dae-b74c-d8305f10623e tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:37.099207 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1e555f11-5008-4dae-b74c-d8305f10623e tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:37.099639 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1e555f11-5008-4dae-b74c-d8305f10623e tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:37.100394 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1e555f11-5008-4dae-b74c-d8305f10623e tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:37.100816 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1e555f11-5008-4dae-b74c-d8305f10623e tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:37.324027 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-1e555f11-5008-4dae-b74c-d8305f10623e tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:37.335313 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-1e555f11-5008-4dae-b74c-d8305f10623e tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1521 microversion: 2.1 time: 0.247407 Mar 31 18:14:37.337054 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 69/156] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:37 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1521 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:37.585702 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-21ae5fd8-6878-47aa-a62d-0b8c26a2511e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:37.586386 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-21ae5fd8-6878-47aa-a62d-0b8c26a2511e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:37.592416 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-21ae5fd8-6878-47aa-a62d-0b8c26a2511e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:37.592853 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-21ae5fd8-6878-47aa-a62d-0b8c26a2511e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:37.593616 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-21ae5fd8-6878-47aa-a62d-0b8c26a2511e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:37.594780 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-21ae5fd8-6878-47aa-a62d-0b8c26a2511e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:37.747268 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-b5e5718d-ae41-41e8-a3cb-9df707a74780 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:37.748098 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-b5e5718d-ae41-41e8-a3cb-9df707a74780 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:37.755161 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b5e5718d-ae41-41e8-a3cb-9df707a74780 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:37.755764 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b5e5718d-ae41-41e8-a3cb-9df707a74780 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:37.756615 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b5e5718d-ae41-41e8-a3cb-9df707a74780 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:37.757261 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b5e5718d-ae41-41e8-a3cb-9df707a74780 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:37.996084 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-21ae5fd8-6878-47aa-a62d-0b8c26a2511e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:38.002361 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-b5e5718d-ae41-41e8-a3cb-9df707a74780 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1dacde91404110b259cfab7a37bb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23366fa77e9049af8c183f6959cc158f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:38.008053 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-21ae5fd8-6878-47aa-a62d-0b8c26a2511e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:38.009821 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-21ae5fd8-6878-47aa-a62d-0b8c26a2511e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:38.010668 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-b5e5718d-ae41-41e8-a3cb-9df707a74780 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] 10.222.0.58 "GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e" status: 200 len: 1314 microversion: 2.1 time: 0.267288 Mar 31 18:14:38.011536 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 70/157] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:37 2022] GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:14:38.011791 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-21ae5fd8-6878-47aa-a62d-0b8c26a2511e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1408 microversion: 2.20 time: 0.430371 Mar 31 18:14:38.019041 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 88/158] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:14:37 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1408 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:14:38.354034 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-bdbf56a6-0f1a-470f-b8c0-0c9e20676deb tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:38.354753 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-bdbf56a6-0f1a-470f-b8c0-0c9e20676deb tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:38.361635 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-bdbf56a6-0f1a-470f-b8c0-0c9e20676deb tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:38.362160 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-bdbf56a6-0f1a-470f-b8c0-0c9e20676deb tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:38.363142 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-bdbf56a6-0f1a-470f-b8c0-0c9e20676deb tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:38.363639 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-bdbf56a6-0f1a-470f-b8c0-0c9e20676deb tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:38.512761 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-bdbf56a6-0f1a-470f-b8c0-0c9e20676deb tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:38.520418 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-bdbf56a6-0f1a-470f-b8c0-0c9e20676deb tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1521 microversion: 2.1 time: 0.171085 Mar 31 18:14:38.520919 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 71/159] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:38 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:14:39.044070 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-cdfd1869-4894-4623-accc-9213d82bdfe6 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:39.044070 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-cdfd1869-4894-4623-accc-9213d82bdfe6 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:39.044070 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-cdfd1869-4894-4623-accc-9213d82bdfe6 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:39.044070 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-cdfd1869-4894-4623-accc-9213d82bdfe6 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:39.045165 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-92e1760d-f069-4331-8972-c55f19ae635c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:39.045269 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-cdfd1869-4894-4623-accc-9213d82bdfe6 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:39.045356 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-92e1760d-f069-4331-8972-c55f19ae635c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:39.045444 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-cdfd1869-4894-4623-accc-9213d82bdfe6 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:39.045540 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-92e1760d-f069-4331-8972-c55f19ae635c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:39.045540 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-92e1760d-f069-4331-8972-c55f19ae635c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:39.045540 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-92e1760d-f069-4331-8972-c55f19ae635c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:39.045773 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-92e1760d-f069-4331-8972-c55f19ae635c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:39.331031 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-cdfd1869-4894-4623-accc-9213d82bdfe6 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1dacde91404110b259cfab7a37bb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23366fa77e9049af8c183f6959cc158f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:39.331031 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-cdfd1869-4894-4623-accc-9213d82bdfe6 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] 10.222.0.58 "GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e" status: 200 len: 1500 microversion: 2.1 time: 0.155958 Mar 31 18:14:39.331031 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 89/160] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:39 2022] GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e => generated 1500 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:39.331317 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-92e1760d-f069-4331-8972-c55f19ae635c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:39.331317 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-92e1760d-f069-4331-8972-c55f19ae635c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:39.331602 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-92e1760d-f069-4331-8972-c55f19ae635c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:39.331602 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-92e1760d-f069-4331-8972-c55f19ae635c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1408 microversion: 2.20 time: 0.164394 Mar 31 18:14:39.331602 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 72/161] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:14:39 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1408 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 31 18:14:39.537753 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-b7faf4cc-355a-4435-baa4-0064efbc0099 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:39.538786 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-b7faf4cc-355a-4435-baa4-0064efbc0099 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:39.545675 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b7faf4cc-355a-4435-baa4-0064efbc0099 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:39.546115 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b7faf4cc-355a-4435-baa4-0064efbc0099 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:39.547520 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b7faf4cc-355a-4435-baa4-0064efbc0099 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:39.547943 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b7faf4cc-355a-4435-baa4-0064efbc0099 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:39.681014 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-b7faf4cc-355a-4435-baa4-0064efbc0099 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:39.699601 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-b7faf4cc-355a-4435-baa4-0064efbc0099 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1521 microversion: 2.1 time: 0.154321 Mar 31 18:14:39.699601 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 90/162] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:39 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:40.334129 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-cd4d2f21-c2e9-45ec-83d3-8a120ae9d508 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:40.334765 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-cd4d2f21-c2e9-45ec-83d3-8a120ae9d508 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:40.340927 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-cd4d2f21-c2e9-45ec-83d3-8a120ae9d508 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:40.341371 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-cd4d2f21-c2e9-45ec-83d3-8a120ae9d508 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:40.342238 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-cd4d2f21-c2e9-45ec-83d3-8a120ae9d508 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:40.342691 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-cd4d2f21-c2e9-45ec-83d3-8a120ae9d508 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:40.480680 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-cd4d2f21-c2e9-45ec-83d3-8a120ae9d508 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:40.489276 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-cd4d2f21-c2e9-45ec-83d3-8a120ae9d508 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:40.490829 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-cd4d2f21-c2e9-45ec-83d3-8a120ae9d508 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:40.491930 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-cd4d2f21-c2e9-45ec-83d3-8a120ae9d508 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1408 microversion: 2.20 time: 0.162086 Mar 31 18:14:40.492485 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 73/163] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:14:40 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1408 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:14:40.705920 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-3d396f4c-79c1-4f2d-b6af-208fee444bf2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:40.706472 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-3d396f4c-79c1-4f2d-b6af-208fee444bf2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:40.712376 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3d396f4c-79c1-4f2d-b6af-208fee444bf2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:40.712819 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3d396f4c-79c1-4f2d-b6af-208fee444bf2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:40.713694 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3d396f4c-79c1-4f2d-b6af-208fee444bf2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:40.714145 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3d396f4c-79c1-4f2d-b6af-208fee444bf2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:40.847777 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-3d396f4c-79c1-4f2d-b6af-208fee444bf2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:40.854920 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-3d396f4c-79c1-4f2d-b6af-208fee444bf2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1521 microversion: 2.1 time: 0.153643 Mar 31 18:14:40.855474 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 91/164] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:40 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:41.509911 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-11710e95-85ba-4311-88ef-eb4dcfc06695 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:41.510592 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-11710e95-85ba-4311-88ef-eb4dcfc06695 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:41.517072 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-11710e95-85ba-4311-88ef-eb4dcfc06695 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:41.517508 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-11710e95-85ba-4311-88ef-eb4dcfc06695 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:41.518384 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-11710e95-85ba-4311-88ef-eb4dcfc06695 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:41.518836 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-11710e95-85ba-4311-88ef-eb4dcfc06695 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:41.662135 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-11710e95-85ba-4311-88ef-eb4dcfc06695 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:41.670329 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-11710e95-85ba-4311-88ef-eb4dcfc06695 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:41.672388 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-11710e95-85ba-4311-88ef-eb4dcfc06695 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:41.673490 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-11710e95-85ba-4311-88ef-eb4dcfc06695 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1408 microversion: 2.20 time: 0.167489 Mar 31 18:14:41.674049 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 74/165] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:14:41 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1408 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:14:41.871819 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-a287dccb-4950-453a-8727-d9da3bc6261a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:41.872427 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-a287dccb-4950-453a-8727-d9da3bc6261a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:41.878793 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a287dccb-4950-453a-8727-d9da3bc6261a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:41.879247 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a287dccb-4950-453a-8727-d9da3bc6261a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:41.880016 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a287dccb-4950-453a-8727-d9da3bc6261a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:41.880452 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a287dccb-4950-453a-8727-d9da3bc6261a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:42.010788 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-a287dccb-4950-453a-8727-d9da3bc6261a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:42.018812 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-a287dccb-4950-453a-8727-d9da3bc6261a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1521 microversion: 2.1 time: 0.150803 Mar 31 18:14:42.019393 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 92/166] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:41 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:42.692134 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-c2340786-bbfa-4879-bffb-f255e3baf029 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:42.692822 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-c2340786-bbfa-4879-bffb-f255e3baf029 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:42.699098 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c2340786-bbfa-4879-bffb-f255e3baf029 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:42.699686 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c2340786-bbfa-4879-bffb-f255e3baf029 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:42.700460 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c2340786-bbfa-4879-bffb-f255e3baf029 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:42.701086 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c2340786-bbfa-4879-bffb-f255e3baf029 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:42.844721 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-c2340786-bbfa-4879-bffb-f255e3baf029 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:42.854382 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-c2340786-bbfa-4879-bffb-f255e3baf029 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:42.856018 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-c2340786-bbfa-4879-bffb-f255e3baf029 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:42.857219 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-c2340786-bbfa-4879-bffb-f255e3baf029 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1408 microversion: 2.20 time: 0.170660 Mar 31 18:14:42.857878 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 75/167] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:14:42 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1408 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:14:43.035886 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-3584b4c8-1181-4597-af20-f285852b491b tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:43.036494 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-3584b4c8-1181-4597-af20-f285852b491b tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:43.042664 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3584b4c8-1181-4597-af20-f285852b491b tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:43.043115 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3584b4c8-1181-4597-af20-f285852b491b tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:43.043883 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3584b4c8-1181-4597-af20-f285852b491b tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:43.044342 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3584b4c8-1181-4597-af20-f285852b491b tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:43.187623 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-3584b4c8-1181-4597-af20-f285852b491b tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:43.194873 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-3584b4c8-1181-4597-af20-f285852b491b tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1521 microversion: 2.1 time: 0.162786 Mar 31 18:14:43.204600 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 93/168] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:43 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:43.876157 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-1059e149-60c1-4844-bc4c-e72327c12758 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:43.876761 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-1059e149-60c1-4844-bc4c-e72327c12758 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:43.882562 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1059e149-60c1-4844-bc4c-e72327c12758 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:43.883030 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1059e149-60c1-4844-bc4c-e72327c12758 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:43.883791 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1059e149-60c1-4844-bc4c-e72327c12758 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:43.884287 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1059e149-60c1-4844-bc4c-e72327c12758 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:44.030639 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-1059e149-60c1-4844-bc4c-e72327c12758 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:44.039166 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-1059e149-60c1-4844-bc4c-e72327c12758 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:44.040591 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-1059e149-60c1-4844-bc4c-e72327c12758 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:44.041800 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-1059e149-60c1-4844-bc4c-e72327c12758 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1599 microversion: 2.20 time: 0.169810 Mar 31 18:14:44.042550 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 76/169] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:14:43 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1599 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:14:44.061620 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-f30ba4b4-25b4-4142-8ef3-d81eba85a7bd tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:44.062362 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-f30ba4b4-25b4-4142-8ef3-d81eba85a7bd tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:44.069009 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f30ba4b4-25b4-4142-8ef3-d81eba85a7bd tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:44.069539 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f30ba4b4-25b4-4142-8ef3-d81eba85a7bd tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:44.074163 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f30ba4b4-25b4-4142-8ef3-d81eba85a7bd tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:44.074163 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f30ba4b4-25b4-4142-8ef3-d81eba85a7bd tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:44.212521 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-00225e00-f1e9-41a3-b6c5-a4c2c15f73b6 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:44.213252 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-00225e00-f1e9-41a3-b6c5-a4c2c15f73b6 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:44.223587 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-00225e00-f1e9-41a3-b6c5-a4c2c15f73b6 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:44.224044 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-00225e00-f1e9-41a3-b6c5-a4c2c15f73b6 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:44.224922 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-00225e00-f1e9-41a3-b6c5-a4c2c15f73b6 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:44.225345 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-00225e00-f1e9-41a3-b6c5-a4c2c15f73b6 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:44.332336 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-f30ba4b4-25b4-4142-8ef3-d81eba85a7bd tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.275081 Mar 31 18:14:44.333491 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 94/170] 10.222.0.58 () {60 vars in 1315 bytes} [Thu Mar 31 18:14:44 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0/os-interface => generated 284 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 31 18:14:44.411197 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-00225e00-f1e9-41a3-b6c5-a4c2c15f73b6 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:44.420556 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-00225e00-f1e9-41a3-b6c5-a4c2c15f73b6 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1521 microversion: 2.1 time: 0.211876 Mar 31 18:14:44.423397 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 77/171] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:44 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1521 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:14:44.591810 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-8eb401c9-1830-4264-9d2c-bcba1639eb3f tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "dffe41dd-3cd3-4c6c-87e3-122727a29703"}} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:14:44.593398 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-8eb401c9-1830-4264-9d2c-bcba1639eb3f tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:44.600646 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8eb401c9-1830-4264-9d2c-bcba1639eb3f tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:44.605588 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8eb401c9-1830-4264-9d2c-bcba1639eb3f tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:44.605588 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8eb401c9-1830-4264-9d2c-bcba1639eb3f tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:44.605588 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8eb401c9-1830-4264-9d2c-bcba1639eb3f tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:45.439203 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-3c276821-5e35-41d8-923b-7149f8783824 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:45.439917 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-3c276821-5e35-41d8-923b-7149f8783824 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:45.445798 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3c276821-5e35-41d8-923b-7149f8783824 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:45.446170 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3c276821-5e35-41d8-923b-7149f8783824 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:45.446989 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3c276821-5e35-41d8-923b-7149f8783824 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:45.447359 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3c276821-5e35-41d8-923b-7149f8783824 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:45.599648 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-3c276821-5e35-41d8-923b-7149f8783824 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:45.607399 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-3c276821-5e35-41d8-923b-7149f8783824 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1521 microversion: 2.1 time: 0.172689 Mar 31 18:14:45.607986 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 78/172] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:45 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:14:45.666307 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-8eb401c9-1830-4264-9d2c-bcba1639eb3f tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] 10.222.0.58 "POST /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.078086 Mar 31 18:14:45.667338 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 95/173] 10.222.0.58 () {60 vars in 1322 bytes} [Thu Mar 31 18:14:44 2022] POST /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e/os-volume_attachments => generated 194 bytes in 1080 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:14:45.778603 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [req-8b79a97d-613f-4a98-af6d-e597486d0aa5 req-eb997a8c-f1af-47ea-8351-8d5e04f3a835 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0", "tag": "3bfd294a-f954-4562-8fbf-0cd104ab3bee"}]} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:14:45.804343 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-8b79a97d-613f-4a98-af6d-e597486d0aa5 req-eb997a8c-f1af-47ea-8351-8d5e04f3a835 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:45.804343 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-8b79a97d-613f-4a98-af6d-e597486d0aa5 req-eb997a8c-f1af-47ea-8351-8d5e04f3a835 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:45.804343 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.compute.server_external_events [req-8b79a97d-613f-4a98-af6d-e597486d0aa5 req-eb997a8c-f1af-47ea-8351-8d5e04f3a835 service nova] Creating event network-changed:3bfd294a-f954-4562-8fbf-0cd104ab3bee for instance 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 on hv-cinder-maste Mar 31 18:14:45.807916 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [req-8b79a97d-613f-4a98-af6d-e597486d0aa5 req-eb997a8c-f1af-47ea-8351-8d5e04f3a835 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034339 Mar 31 18:14:45.808763 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 79/174] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:14:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:14:46.625231 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-cd704ab8-a915-4b40-b2c7-542215031734 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:46.626140 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-cd704ab8-a915-4b40-b2c7-542215031734 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:46.632295 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-cd704ab8-a915-4b40-b2c7-542215031734 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:46.632736 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-cd704ab8-a915-4b40-b2c7-542215031734 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:46.633499 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-cd704ab8-a915-4b40-b2c7-542215031734 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:46.633924 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-cd704ab8-a915-4b40-b2c7-542215031734 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:46.786662 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-cd704ab8-a915-4b40-b2c7-542215031734 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:46.794567 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-cd704ab8-a915-4b40-b2c7-542215031734 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1521 microversion: 2.1 time: 0.174017 Mar 31 18:14:46.795736 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 96/175] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:46 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:47.819354 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-8b68cd3b-38f1-4966-a59a-7481dfd6fcf5 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:47.820060 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-8b68cd3b-38f1-4966-a59a-7481dfd6fcf5 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:47.827366 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-8b68cd3b-38f1-4966-a59a-7481dfd6fcf5 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:47.828008 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-8b68cd3b-38f1-4966-a59a-7481dfd6fcf5 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:47.828794 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-8b68cd3b-38f1-4966-a59a-7481dfd6fcf5 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:47.829230 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-8b68cd3b-38f1-4966-a59a-7481dfd6fcf5 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:47.997044 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-8b68cd3b-38f1-4966-a59a-7481dfd6fcf5 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:48.004548 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-8b68cd3b-38f1-4966-a59a-7481dfd6fcf5 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1521 microversion: 2.1 time: 0.189619 Mar 31 18:14:48.005124 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 80/176] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:47 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:49.021351 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-81404f45-b5c0-43f4-b230-76d67ff50b00 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:49.022050 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-81404f45-b5c0-43f4-b230-76d67ff50b00 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:49.028828 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-81404f45-b5c0-43f4-b230-76d67ff50b00 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:49.029347 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-81404f45-b5c0-43f4-b230-76d67ff50b00 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:49.030369 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-81404f45-b5c0-43f4-b230-76d67ff50b00 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:49.030891 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-81404f45-b5c0-43f4-b230-76d67ff50b00 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:49.170870 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-81404f45-b5c0-43f4-b230-76d67ff50b00 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:49.178486 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-81404f45-b5c0-43f4-b230-76d67ff50b00 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1521 microversion: 2.1 time: 0.161000 Mar 31 18:14:49.179128 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 97/177] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:49 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:50.197091 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-61682ddf-4adc-43fa-9c97-dfc4e001d681 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:50.197689 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-61682ddf-4adc-43fa-9c97-dfc4e001d681 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:50.204304 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-61682ddf-4adc-43fa-9c97-dfc4e001d681 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:50.204746 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-61682ddf-4adc-43fa-9c97-dfc4e001d681 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:50.212643 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-61682ddf-4adc-43fa-9c97-dfc4e001d681 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:50.212643 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-61682ddf-4adc-43fa-9c97-dfc4e001d681 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:50.340628 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-61682ddf-4adc-43fa-9c97-dfc4e001d681 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:50.348417 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-61682ddf-4adc-43fa-9c97-dfc4e001d681 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1521 microversion: 2.1 time: 0.155097 Mar 31 18:14:50.349014 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 81/178] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:50 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:51.366573 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-4a11ddad-67f5-4dc0-a7b4-81fc797ff306 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:51.367211 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-4a11ddad-67f5-4dc0-a7b4-81fc797ff306 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:51.374681 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4a11ddad-67f5-4dc0-a7b4-81fc797ff306 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:51.375206 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4a11ddad-67f5-4dc0-a7b4-81fc797ff306 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:51.376055 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4a11ddad-67f5-4dc0-a7b4-81fc797ff306 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:51.376556 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4a11ddad-67f5-4dc0-a7b4-81fc797ff306 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:51.520236 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-4a11ddad-67f5-4dc0-a7b4-81fc797ff306 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:51.527931 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-4a11ddad-67f5-4dc0-a7b4-81fc797ff306 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1521 microversion: 2.1 time: 0.165208 Mar 31 18:14:51.529711 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 98/179] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:51 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:52.546679 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-5b247e49-fc04-4dc4-a6ea-44d9e41e986e tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:52.547211 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-5b247e49-fc04-4dc4-a6ea-44d9e41e986e tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:52.553214 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-5b247e49-fc04-4dc4-a6ea-44d9e41e986e tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:52.553653 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-5b247e49-fc04-4dc4-a6ea-44d9e41e986e tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:52.554400 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-5b247e49-fc04-4dc4-a6ea-44d9e41e986e tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:52.554851 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-5b247e49-fc04-4dc4-a6ea-44d9e41e986e tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:52.692795 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-5b247e49-fc04-4dc4-a6ea-44d9e41e986e tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:52.700594 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-5b247e49-fc04-4dc4-a6ea-44d9e41e986e tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1521 microversion: 2.1 time: 0.158136 Mar 31 18:14:52.701172 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 82/180] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:52 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:53.718573 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-592fa4f0-c615-4749-9cb7-05f94faec608 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:53.719226 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-592fa4f0-c615-4749-9cb7-05f94faec608 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:53.725583 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-592fa4f0-c615-4749-9cb7-05f94faec608 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:53.726028 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-592fa4f0-c615-4749-9cb7-05f94faec608 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:53.726820 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-592fa4f0-c615-4749-9cb7-05f94faec608 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:53.727252 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-592fa4f0-c615-4749-9cb7-05f94faec608 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:53.859450 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-592fa4f0-c615-4749-9cb7-05f94faec608 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:53.866787 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-592fa4f0-c615-4749-9cb7-05f94faec608 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1521 microversion: 2.1 time: 0.153156 Mar 31 18:14:53.867360 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 99/181] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:53 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:54.885123 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-6a49786a-095a-4a61-9563-68b515f41ed2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:54.885727 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-6a49786a-095a-4a61-9563-68b515f41ed2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:54.892792 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-6a49786a-095a-4a61-9563-68b515f41ed2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:54.893241 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-6a49786a-095a-4a61-9563-68b515f41ed2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:54.894082 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-6a49786a-095a-4a61-9563-68b515f41ed2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:54.894519 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-6a49786a-095a-4a61-9563-68b515f41ed2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:55.035397 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-6a49786a-095a-4a61-9563-68b515f41ed2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:55.044038 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-6a49786a-095a-4a61-9563-68b515f41ed2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1521 microversion: 2.1 time: 0.163497 Mar 31 18:14:55.044620 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 83/182] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:54 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1521 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:56.061988 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-296c55ae-7214-4869-8fa2-b5ba32bfb3a4 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:56.062597 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-296c55ae-7214-4869-8fa2-b5ba32bfb3a4 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:56.069150 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-296c55ae-7214-4869-8fa2-b5ba32bfb3a4 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:56.069595 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-296c55ae-7214-4869-8fa2-b5ba32bfb3a4 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:56.070376 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-296c55ae-7214-4869-8fa2-b5ba32bfb3a4 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:56.070830 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-296c55ae-7214-4869-8fa2-b5ba32bfb3a4 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:56.206063 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-296c55ae-7214-4869-8fa2-b5ba32bfb3a4 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:56.213455 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-296c55ae-7214-4869-8fa2-b5ba32bfb3a4 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1521 microversion: 2.1 time: 0.156258 Mar 31 18:14:56.214017 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 100/183] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:56 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:57.230235 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-acd7fb84-7d95-4a69-990a-a16ecd1a6698 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:57.230900 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-acd7fb84-7d95-4a69-990a-a16ecd1a6698 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:57.236728 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-acd7fb84-7d95-4a69-990a-a16ecd1a6698 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:57.237163 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-acd7fb84-7d95-4a69-990a-a16ecd1a6698 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:57.237915 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-acd7fb84-7d95-4a69-990a-a16ecd1a6698 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:57.238337 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-acd7fb84-7d95-4a69-990a-a16ecd1a6698 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:57.369346 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-acd7fb84-7d95-4a69-990a-a16ecd1a6698 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:57.377079 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-acd7fb84-7d95-4a69-990a-a16ecd1a6698 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1521 microversion: 2.1 time: 0.150705 Mar 31 18:14:57.377641 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 84/184] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:57 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:58.393970 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-6fa8f0db-655a-45ef-8ab0-77e2571d3384 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:58.394620 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-6fa8f0db-655a-45ef-8ab0-77e2571d3384 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:58.400909 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6fa8f0db-655a-45ef-8ab0-77e2571d3384 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:58.401359 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6fa8f0db-655a-45ef-8ab0-77e2571d3384 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:58.405498 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6fa8f0db-655a-45ef-8ab0-77e2571d3384 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:58.405498 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6fa8f0db-655a-45ef-8ab0-77e2571d3384 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:58.538512 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-6fa8f0db-655a-45ef-8ab0-77e2571d3384 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:58.546084 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-6fa8f0db-655a-45ef-8ab0-77e2571d3384 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1521 microversion: 2.1 time: 0.156409 Mar 31 18:14:58.546662 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 101/185] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:58 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:14:59.564114 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-8f82b65e-49af-4aaf-9283-e5c94791f1fb tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:14:59.564712 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-8f82b65e-49af-4aaf-9283-e5c94791f1fb tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:14:59.570743 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-8f82b65e-49af-4aaf-9283-e5c94791f1fb tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:59.571178 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-8f82b65e-49af-4aaf-9283-e5c94791f1fb tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:59.571935 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-8f82b65e-49af-4aaf-9283-e5c94791f1fb tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:14:59.572351 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-8f82b65e-49af-4aaf-9283-e5c94791f1fb tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:14:59.717448 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-8f82b65e-49af-4aaf-9283-e5c94791f1fb tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:14:59.725435 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-8f82b65e-49af-4aaf-9283-e5c94791f1fb tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1521 microversion: 2.1 time: 0.165164 Mar 31 18:14:59.735205 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 85/186] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:14:59 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1521 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:00.742456 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-746b896e-a19d-4d57-a621-f62370b4c093 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:00.743067 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-746b896e-a19d-4d57-a621-f62370b4c093 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:00.749911 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-746b896e-a19d-4d57-a621-f62370b4c093 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:00.750393 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-746b896e-a19d-4d57-a621-f62370b4c093 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:00.751182 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-746b896e-a19d-4d57-a621-f62370b4c093 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:00.751614 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-746b896e-a19d-4d57-a621-f62370b4c093 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:00.897771 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-746b896e-a19d-4d57-a621-f62370b4c093 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:00.905539 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-746b896e-a19d-4d57-a621-f62370b4c093 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1521 microversion: 2.1 time: 0.166823 Mar 31 18:15:00.915539 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 102/187] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:00 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:01.923604 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-5e248df5-44a6-4045-9a7a-9da81508c9d5 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:01.924179 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-5e248df5-44a6-4045-9a7a-9da81508c9d5 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:01.930204 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-5e248df5-44a6-4045-9a7a-9da81508c9d5 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:01.930667 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-5e248df5-44a6-4045-9a7a-9da81508c9d5 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:01.931424 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-5e248df5-44a6-4045-9a7a-9da81508c9d5 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:01.931842 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-5e248df5-44a6-4045-9a7a-9da81508c9d5 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:02.074696 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-5e248df5-44a6-4045-9a7a-9da81508c9d5 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:02.082182 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-5e248df5-44a6-4045-9a7a-9da81508c9d5 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1521 microversion: 2.1 time: 0.162452 Mar 31 18:15:02.082783 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 86/188] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:01 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:15:03.099384 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-e4dc3b00-3c1b-45a0-97c4-e68743911169 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:03.099990 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-e4dc3b00-3c1b-45a0-97c4-e68743911169 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:03.106978 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e4dc3b00-3c1b-45a0-97c4-e68743911169 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:03.107418 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e4dc3b00-3c1b-45a0-97c4-e68743911169 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:03.108191 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e4dc3b00-3c1b-45a0-97c4-e68743911169 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:03.108624 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e4dc3b00-3c1b-45a0-97c4-e68743911169 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:03.240183 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-e4dc3b00-3c1b-45a0-97c4-e68743911169 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:03.247820 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-e4dc3b00-3c1b-45a0-97c4-e68743911169 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1521 microversion: 2.1 time: 0.152284 Mar 31 18:15:03.248390 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 103/189] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:03 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:04.067299 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-78c7e8ea-7367-47aa-a50b-948b1e17574f tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-536274057", "imageRef": "6241b999-6f6d-4076-88bc-345fa7386256", "flavorRef": "452"}} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:15:04.123419 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.network.neutron [None req-78c7e8ea-7367-47aa-a50b-948b1e17574f tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] validate_networks() for None {{(pid=117539) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 31 18:15:04.265166 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-07b4cbae-8711-455c-9dcf-8ae43cb8e1b2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:04.265897 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-07b4cbae-8711-455c-9dcf-8ae43cb8e1b2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:04.272532 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-07b4cbae-8711-455c-9dcf-8ae43cb8e1b2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:04.273115 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-07b4cbae-8711-455c-9dcf-8ae43cb8e1b2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:04.273958 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-07b4cbae-8711-455c-9dcf-8ae43cb8e1b2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:04.274476 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-07b4cbae-8711-455c-9dcf-8ae43cb8e1b2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:04.411795 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.virt.hardware [None req-78c7e8ea-7367-47aa-a50b-948b1e17574f tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Flavor limits 0:0:0 {{(pid=117539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 31 18:15:04.412292 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.virt.hardware [None req-78c7e8ea-7367-47aa-a50b-948b1e17574f tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Image limits 0:0:0 {{(pid=117539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 31 18:15:04.433429 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.virt.hardware [None req-78c7e8ea-7367-47aa-a50b-948b1e17574f tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Flavor pref 0:0:0 {{(pid=117539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 31 18:15:04.433429 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.virt.hardware [None req-78c7e8ea-7367-47aa-a50b-948b1e17574f tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Image pref 0:0:0 {{(pid=117539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 31 18:15:04.433429 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.virt.hardware [None req-78c7e8ea-7367-47aa-a50b-948b1e17574f tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 31 18:15:04.433429 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-78c7e8ea-7367-47aa-a50b-948b1e17574f tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:04.433429 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-78c7e8ea-7367-47aa-a50b-948b1e17574f tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:04.434011 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-78c7e8ea-7367-47aa-a50b-948b1e17574f tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:04.434099 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-07b4cbae-8711-455c-9dcf-8ae43cb8e1b2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:04.434199 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-78c7e8ea-7367-47aa-a50b-948b1e17574f tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:04.434432 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-07b4cbae-8711-455c-9dcf-8ae43cb8e1b2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1521 microversion: 2.1 time: 0.172145 Mar 31 18:15:04.435641 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 104/190] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:04 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1521 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:15:04.453191 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.quota [None req-78c7e8ea-7367-47aa-a50b-948b1e17574f tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Getting quotas for project b822e17d08cf49f79e8fd7faaa92a0a3. Resources: {'instances', 'ram', 'cores'} {{(pid=117539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 31 18:15:04.458690 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.quota [None req-78c7e8ea-7367-47aa-a50b-948b1e17574f tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Getting quotas for user 0be7ea3f86e04222ba3de78ec21b2b0b and project b822e17d08cf49f79e8fd7faaa92a0a3. Resources: {'instances', 'ram', 'cores'} {{(pid=117539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 31 18:15:04.470403 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-78c7e8ea-7367-47aa-a50b-948b1e17574f tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Going to run 1 instances... {{(pid=117539) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 31 18:15:04.472898 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-78c7e8ea-7367-47aa-a50b-948b1e17574f tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] [instance: 6bcf99af-f089-4543-94c0-39ecee139bf7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6241b999-6f6d-4076-88bc-345fa7386256',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 31 18:15:04.718359 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-78c7e8ea-7367-47aa-a50b-948b1e17574f tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.656058 Mar 31 18:15:04.719038 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 87/191] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Mar 31 18:15:04 2022] POST /compute/v2.1/servers => generated 380 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 31 18:15:04.729458 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-84ab939c-c823-4e8e-b3f0-063728347ae7 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:04.730067 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-84ab939c-c823-4e8e-b3f0-063728347ae7 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] [instance: 6bcf99af-f089-4543-94c0-39ecee139bf7] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:04.780404 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-84ab939c-c823-4e8e-b3f0-063728347ae7 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be7ea3f86e04222ba3de78ec21b2b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b822e17d08cf49f79e8fd7faaa92a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:04.787190 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-84ab939c-c823-4e8e-b3f0-063728347ae7 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] 10.222.0.58 "GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7" status: 200 len: 1214 microversion: 2.1 time: 0.062191 Mar 31 18:15:04.787758 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 105/192] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:04 2022] GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7 => generated 1214 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:05.452266 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-45ae8bed-e9a0-4152-be31-7f07cbdf14e5 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:05.452769 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-45ae8bed-e9a0-4152-be31-7f07cbdf14e5 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:05.458890 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-45ae8bed-e9a0-4152-be31-7f07cbdf14e5 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:05.459333 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-45ae8bed-e9a0-4152-be31-7f07cbdf14e5 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:05.460093 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-45ae8bed-e9a0-4152-be31-7f07cbdf14e5 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:05.460520 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-45ae8bed-e9a0-4152-be31-7f07cbdf14e5 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:05.597879 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-45ae8bed-e9a0-4152-be31-7f07cbdf14e5 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:05.605885 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-45ae8bed-e9a0-4152-be31-7f07cbdf14e5 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1521 microversion: 2.1 time: 0.158128 Mar 31 18:15:05.606472 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 88/193] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:05 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:15:05.805161 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-79dfe288-e9b7-472d-b35b-2ec7b0de1286 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:05.805768 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-79dfe288-e9b7-472d-b35b-2ec7b0de1286 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] [instance: 6bcf99af-f089-4543-94c0-39ecee139bf7] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:05.858373 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-79dfe288-e9b7-472d-b35b-2ec7b0de1286 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be7ea3f86e04222ba3de78ec21b2b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b822e17d08cf49f79e8fd7faaa92a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:05.865578 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-79dfe288-e9b7-472d-b35b-2ec7b0de1286 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] 10.222.0.58 "GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7" status: 200 len: 1214 microversion: 2.1 time: 0.064231 Mar 31 18:15:05.866269 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 106/194] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:05 2022] GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7 => generated 1214 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:06.623379 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-2b35fe8d-f739-4f46-b797-226ab9e81bf2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:06.623891 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-2b35fe8d-f739-4f46-b797-226ab9e81bf2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:06.629711 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-2b35fe8d-f739-4f46-b797-226ab9e81bf2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:06.630146 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-2b35fe8d-f739-4f46-b797-226ab9e81bf2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:06.630925 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-2b35fe8d-f739-4f46-b797-226ab9e81bf2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:06.631352 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-2b35fe8d-f739-4f46-b797-226ab9e81bf2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:06.765672 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-2b35fe8d-f739-4f46-b797-226ab9e81bf2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:06.773362 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-2b35fe8d-f739-4f46-b797-226ab9e81bf2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1521 microversion: 2.1 time: 0.154481 Mar 31 18:15:06.773967 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 89/195] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:06 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:06.885046 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-aca39567-05fa-4bcd-a57e-774e28571ae6 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:06.885602 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-aca39567-05fa-4bcd-a57e-774e28571ae6 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] [instance: 6bcf99af-f089-4543-94c0-39ecee139bf7] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:06.891820 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-aca39567-05fa-4bcd-a57e-774e28571ae6 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:06.892266 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-aca39567-05fa-4bcd-a57e-774e28571ae6 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:06.893029 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-aca39567-05fa-4bcd-a57e-774e28571ae6 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:06.893457 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-aca39567-05fa-4bcd-a57e-774e28571ae6 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:06.958995 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-aca39567-05fa-4bcd-a57e-774e28571ae6 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be7ea3f86e04222ba3de78ec21b2b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b822e17d08cf49f79e8fd7faaa92a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:06.967156 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-aca39567-05fa-4bcd-a57e-774e28571ae6 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] 10.222.0.58 "GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7" status: 200 len: 1218 microversion: 2.1 time: 0.086152 Mar 31 18:15:06.967728 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 107/196] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:06 2022] GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:07.790553 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-03282592-368a-4e2a-b9f9-c9e7764b742a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:07.791280 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-03282592-368a-4e2a-b9f9-c9e7764b742a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:07.797183 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-03282592-368a-4e2a-b9f9-c9e7764b742a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:07.797628 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-03282592-368a-4e2a-b9f9-c9e7764b742a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:07.798391 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-03282592-368a-4e2a-b9f9-c9e7764b742a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:07.798862 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-03282592-368a-4e2a-b9f9-c9e7764b742a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:07.929606 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-03282592-368a-4e2a-b9f9-c9e7764b742a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:07.937396 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-03282592-368a-4e2a-b9f9-c9e7764b742a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1521 microversion: 2.1 time: 0.150746 Mar 31 18:15:07.937967 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 90/197] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:07 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:07.983758 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-c17fa5a8-830c-48c9-bc53-7fd05de625fc tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:07.984365 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-c17fa5a8-830c-48c9-bc53-7fd05de625fc tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] [instance: 6bcf99af-f089-4543-94c0-39ecee139bf7] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:07.990726 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c17fa5a8-830c-48c9-bc53-7fd05de625fc tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:07.991171 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c17fa5a8-830c-48c9-bc53-7fd05de625fc tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:07.991962 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c17fa5a8-830c-48c9-bc53-7fd05de625fc tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:07.992386 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c17fa5a8-830c-48c9-bc53-7fd05de625fc tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:08.057096 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-c17fa5a8-830c-48c9-bc53-7fd05de625fc tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be7ea3f86e04222ba3de78ec21b2b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b822e17d08cf49f79e8fd7faaa92a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:08.060515 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-c17fa5a8-830c-48c9-bc53-7fd05de625fc tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] 10.222.0.58 "GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7" status: 200 len: 1218 microversion: 2.1 time: 0.080501 Mar 31 18:15:08.061882 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 108/198] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:07 2022] GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:08.953186 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-6459efc2-8604-4c12-b188-b0788e75501d tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:08.953817 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-6459efc2-8604-4c12-b188-b0788e75501d tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:08.959664 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-6459efc2-8604-4c12-b188-b0788e75501d tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:08.960100 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-6459efc2-8604-4c12-b188-b0788e75501d tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:08.960844 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-6459efc2-8604-4c12-b188-b0788e75501d tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:08.961269 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-6459efc2-8604-4c12-b188-b0788e75501d tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:09.077450 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-267ed3e4-f1c9-4126-99ce-c1e7ca6cafb8 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:09.078048 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-267ed3e4-f1c9-4126-99ce-c1e7ca6cafb8 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] [instance: 6bcf99af-f089-4543-94c0-39ecee139bf7] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:09.084301 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-267ed3e4-f1c9-4126-99ce-c1e7ca6cafb8 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:09.084749 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-267ed3e4-f1c9-4126-99ce-c1e7ca6cafb8 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:09.085516 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-267ed3e4-f1c9-4126-99ce-c1e7ca6cafb8 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:09.085948 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-267ed3e4-f1c9-4126-99ce-c1e7ca6cafb8 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:09.094871 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-6459efc2-8604-4c12-b188-b0788e75501d tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:09.102044 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-6459efc2-8604-4c12-b188-b0788e75501d tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1521 microversion: 2.1 time: 0.152721 Mar 31 18:15:09.103459 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 91/199] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:08 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:09.146394 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-267ed3e4-f1c9-4126-99ce-c1e7ca6cafb8 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be7ea3f86e04222ba3de78ec21b2b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b822e17d08cf49f79e8fd7faaa92a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:09.154079 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-267ed3e4-f1c9-4126-99ce-c1e7ca6cafb8 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] 10.222.0.58 "GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7" status: 200 len: 1218 microversion: 2.1 time: 0.080595 Mar 31 18:15:09.154752 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 109/200] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:09 2022] GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7 => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:10.119245 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-b41dcced-1c6b-4270-86e0-f9ebe984a519 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:10.119854 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-b41dcced-1c6b-4270-86e0-f9ebe984a519 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:10.127009 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b41dcced-1c6b-4270-86e0-f9ebe984a519 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:10.127474 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b41dcced-1c6b-4270-86e0-f9ebe984a519 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:10.128242 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b41dcced-1c6b-4270-86e0-f9ebe984a519 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:10.128667 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b41dcced-1c6b-4270-86e0-f9ebe984a519 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:10.171685 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-be5be58e-2b59-4b69-967a-84f698cdfa5d tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:10.172852 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-be5be58e-2b59-4b69-967a-84f698cdfa5d tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] [instance: 6bcf99af-f089-4543-94c0-39ecee139bf7] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:10.179295 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-be5be58e-2b59-4b69-967a-84f698cdfa5d tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:10.179739 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-be5be58e-2b59-4b69-967a-84f698cdfa5d tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:10.180498 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-be5be58e-2b59-4b69-967a-84f698cdfa5d tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:10.181055 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-be5be58e-2b59-4b69-967a-84f698cdfa5d tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:10.245653 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-be5be58e-2b59-4b69-967a-84f698cdfa5d tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be7ea3f86e04222ba3de78ec21b2b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b822e17d08cf49f79e8fd7faaa92a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:10.252998 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-be5be58e-2b59-4b69-967a-84f698cdfa5d tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] 10.222.0.58 "GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7" status: 200 len: 1266 microversion: 2.1 time: 0.085264 Mar 31 18:15:10.253581 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 110/201] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:10 2022] GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7 => generated 1266 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:15:10.279631 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-b41dcced-1c6b-4270-86e0-f9ebe984a519 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:10.287205 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-b41dcced-1c6b-4270-86e0-f9ebe984a519 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1521 microversion: 2.1 time: 0.171802 Mar 31 18:15:10.287710 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 92/202] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:10 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:11.271050 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-7a6156eb-73aa-4479-9cc9-bf31cb149338 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:11.272256 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-7a6156eb-73aa-4479-9cc9-bf31cb149338 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] [instance: 6bcf99af-f089-4543-94c0-39ecee139bf7] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:11.280150 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-7a6156eb-73aa-4479-9cc9-bf31cb149338 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:11.280807 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-7a6156eb-73aa-4479-9cc9-bf31cb149338 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:11.281769 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-7a6156eb-73aa-4479-9cc9-bf31cb149338 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:11.282361 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-7a6156eb-73aa-4479-9cc9-bf31cb149338 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:11.305403 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-2a479598-b4d0-4801-8702-bef7123cc4ba tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:11.306903 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-2a479598-b4d0-4801-8702-bef7123cc4ba tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:11.315986 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-2a479598-b4d0-4801-8702-bef7123cc4ba tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:11.315986 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-2a479598-b4d0-4801-8702-bef7123cc4ba tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:11.315986 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-2a479598-b4d0-4801-8702-bef7123cc4ba tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:11.315986 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-2a479598-b4d0-4801-8702-bef7123cc4ba tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:11.349266 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-7a6156eb-73aa-4479-9cc9-bf31cb149338 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be7ea3f86e04222ba3de78ec21b2b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b822e17d08cf49f79e8fd7faaa92a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:11.356892 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-7a6156eb-73aa-4479-9cc9-bf31cb149338 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] 10.222.0.58 "GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7" status: 200 len: 1266 microversion: 2.1 time: 0.089882 Mar 31 18:15:11.367121 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 111/203] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:11 2022] GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7 => generated 1266 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:15:11.463920 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-2a479598-b4d0-4801-8702-bef7123cc4ba tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:11.471474 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-2a479598-b4d0-4801-8702-bef7123cc4ba tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1521 microversion: 2.1 time: 0.171233 Mar 31 18:15:11.472048 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 93/204] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:11 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1521 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:15:12.373542 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-8980295c-d4c6-42a2-9616-dc260eb88fbf tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:12.374202 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-8980295c-d4c6-42a2-9616-dc260eb88fbf tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] [instance: 6bcf99af-f089-4543-94c0-39ecee139bf7] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:12.380729 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8980295c-d4c6-42a2-9616-dc260eb88fbf tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:12.386727 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8980295c-d4c6-42a2-9616-dc260eb88fbf tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:12.386727 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8980295c-d4c6-42a2-9616-dc260eb88fbf tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:12.386727 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8980295c-d4c6-42a2-9616-dc260eb88fbf tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:12.447402 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-8980295c-d4c6-42a2-9616-dc260eb88fbf tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be7ea3f86e04222ba3de78ec21b2b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b822e17d08cf49f79e8fd7faaa92a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:12.451849 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-8980295c-d4c6-42a2-9616-dc260eb88fbf tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] 10.222.0.58 "GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7" status: 200 len: 1266 microversion: 2.1 time: 0.082052 Mar 31 18:15:12.452418 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 112/205] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:12 2022] GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7 => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:12.488785 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-f0e0919f-9397-4947-9348-5c461d81b7ac tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:12.489391 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-f0e0919f-9397-4947-9348-5c461d81b7ac tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:12.496005 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-f0e0919f-9397-4947-9348-5c461d81b7ac tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:12.496451 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-f0e0919f-9397-4947-9348-5c461d81b7ac tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:12.497213 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-f0e0919f-9397-4947-9348-5c461d81b7ac tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:12.497644 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-f0e0919f-9397-4947-9348-5c461d81b7ac tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:12.635976 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-f0e0919f-9397-4947-9348-5c461d81b7ac tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:12.643480 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-f0e0919f-9397-4947-9348-5c461d81b7ac tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1521 microversion: 2.1 time: 0.158589 Mar 31 18:15:12.644225 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 94/206] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:12 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:13.468955 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-34b57ec4-0fa1-414c-a934-4b74965f7ece tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:13.469594 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-34b57ec4-0fa1-414c-a934-4b74965f7ece tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] [instance: 6bcf99af-f089-4543-94c0-39ecee139bf7] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:13.475854 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-34b57ec4-0fa1-414c-a934-4b74965f7ece tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:13.476303 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-34b57ec4-0fa1-414c-a934-4b74965f7ece tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:13.477614 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-34b57ec4-0fa1-414c-a934-4b74965f7ece tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:13.478043 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-34b57ec4-0fa1-414c-a934-4b74965f7ece tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:13.546535 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-34b57ec4-0fa1-414c-a934-4b74965f7ece tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be7ea3f86e04222ba3de78ec21b2b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b822e17d08cf49f79e8fd7faaa92a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:13.553765 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-34b57ec4-0fa1-414c-a934-4b74965f7ece tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] 10.222.0.58 "GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7" status: 200 len: 1266 microversion: 2.1 time: 0.088675 Mar 31 18:15:13.554468 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 113/207] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:13 2022] GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7 => generated 1266 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:13.660054 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-67774957-447d-4356-9f93-9cc02c9add30 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:13.660655 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-67774957-447d-4356-9f93-9cc02c9add30 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:13.666642 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-67774957-447d-4356-9f93-9cc02c9add30 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:13.667101 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-67774957-447d-4356-9f93-9cc02c9add30 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:13.667854 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-67774957-447d-4356-9f93-9cc02c9add30 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:13.668281 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-67774957-447d-4356-9f93-9cc02c9add30 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:13.808832 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-67774957-447d-4356-9f93-9cc02c9add30 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:13.816227 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-67774957-447d-4356-9f93-9cc02c9add30 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1521 microversion: 2.1 time: 0.160107 Mar 31 18:15:13.817040 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 95/208] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:13 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:14.572521 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-fa988669-9739-493a-a625-a24317402635 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:14.573172 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-fa988669-9739-493a-a625-a24317402635 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] [instance: 6bcf99af-f089-4543-94c0-39ecee139bf7] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:14.579356 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-fa988669-9739-493a-a625-a24317402635 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:14.579754 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-fa988669-9739-493a-a625-a24317402635 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:14.580498 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-fa988669-9739-493a-a625-a24317402635 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:14.580920 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-fa988669-9739-493a-a625-a24317402635 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:14.640257 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-fa988669-9739-493a-a625-a24317402635 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be7ea3f86e04222ba3de78ec21b2b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b822e17d08cf49f79e8fd7faaa92a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:14.648118 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-fa988669-9739-493a-a625-a24317402635 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] 10.222.0.58 "GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7" status: 200 len: 1266 microversion: 2.1 time: 0.079537 Mar 31 18:15:14.649191 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 114/209] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:14 2022] GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7 => generated 1266 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:14.833323 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-52b1eb02-bb2c-4766-837e-7f96be2b8e67 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:14.834829 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-52b1eb02-bb2c-4766-837e-7f96be2b8e67 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:14.840744 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-52b1eb02-bb2c-4766-837e-7f96be2b8e67 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:14.841187 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-52b1eb02-bb2c-4766-837e-7f96be2b8e67 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:14.842156 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-52b1eb02-bb2c-4766-837e-7f96be2b8e67 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:14.842656 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-52b1eb02-bb2c-4766-837e-7f96be2b8e67 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:14.980169 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-52b1eb02-bb2c-4766-837e-7f96be2b8e67 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:14.988442 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-52b1eb02-bb2c-4766-837e-7f96be2b8e67 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1521 microversion: 2.1 time: 0.158804 Mar 31 18:15:14.988920 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 96/210] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:14 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:15.667150 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-d2738894-19ec-4d11-8b99-d8649c60099b tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:15.667896 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-d2738894-19ec-4d11-8b99-d8649c60099b tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] [instance: 6bcf99af-f089-4543-94c0-39ecee139bf7] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:15.673871 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-d2738894-19ec-4d11-8b99-d8649c60099b tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:15.674314 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-d2738894-19ec-4d11-8b99-d8649c60099b tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:15.675151 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-d2738894-19ec-4d11-8b99-d8649c60099b tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:15.675580 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-d2738894-19ec-4d11-8b99-d8649c60099b tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:15.747669 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-d2738894-19ec-4d11-8b99-d8649c60099b tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be7ea3f86e04222ba3de78ec21b2b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b822e17d08cf49f79e8fd7faaa92a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:15.755106 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-d2738894-19ec-4d11-8b99-d8649c60099b tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] 10.222.0.58 "GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7" status: 200 len: 1272 microversion: 2.1 time: 0.092903 Mar 31 18:15:15.758470 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 115/211] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:15 2022] GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7 => generated 1272 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:16.005310 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-8e6066b5-a4b1-4e3c-b237-d71a8a488ec9 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:16.005909 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-8e6066b5-a4b1-4e3c-b237-d71a8a488ec9 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:16.012850 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-8e6066b5-a4b1-4e3c-b237-d71a8a488ec9 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:16.013182 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-8e6066b5-a4b1-4e3c-b237-d71a8a488ec9 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:16.014136 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-8e6066b5-a4b1-4e3c-b237-d71a8a488ec9 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:16.014564 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-8e6066b5-a4b1-4e3c-b237-d71a8a488ec9 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:16.181107 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-8e6066b5-a4b1-4e3c-b237-d71a8a488ec9 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:16.191130 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-8e6066b5-a4b1-4e3c-b237-d71a8a488ec9 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1521 microversion: 2.1 time: 0.189620 Mar 31 18:15:16.191908 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 97/212] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:16 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:16.773256 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-e030306d-3dab-48ec-b46d-a820100bd517 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:16.774167 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-e030306d-3dab-48ec-b46d-a820100bd517 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] [instance: 6bcf99af-f089-4543-94c0-39ecee139bf7] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:16.780339 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e030306d-3dab-48ec-b46d-a820100bd517 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:16.780872 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e030306d-3dab-48ec-b46d-a820100bd517 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:16.781640 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e030306d-3dab-48ec-b46d-a820100bd517 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:16.782067 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e030306d-3dab-48ec-b46d-a820100bd517 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:16.947477 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-e030306d-3dab-48ec-b46d-a820100bd517 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be7ea3f86e04222ba3de78ec21b2b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b822e17d08cf49f79e8fd7faaa92a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:16.954733 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-e030306d-3dab-48ec-b46d-a820100bd517 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] 10.222.0.58 "GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7" status: 200 len: 1314 microversion: 2.1 time: 0.185490 Mar 31 18:15:16.955293 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 116/213] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:16 2022] GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7 => generated 1314 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:17.209490 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-a7e143d1-7f4f-458b-b151-9a98d48b9ae8 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:17.210086 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-a7e143d1-7f4f-458b-b151-9a98d48b9ae8 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:17.217079 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a7e143d1-7f4f-458b-b151-9a98d48b9ae8 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:17.217524 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a7e143d1-7f4f-458b-b151-9a98d48b9ae8 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:17.218283 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a7e143d1-7f4f-458b-b151-9a98d48b9ae8 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:17.218792 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a7e143d1-7f4f-458b-b151-9a98d48b9ae8 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:17.339480 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [req-269ae6dc-5810-44ca-922b-a6b3c85bce64 req-39033a63-1417-40c3-905f-385b7d4c3697 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6bcf99af-f089-4543-94c0-39ecee139bf7", "tag": "b90b496d-8c4e-46bd-93a0-9e0e45bd14f0"}]} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:15:17.349188 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-269ae6dc-5810-44ca-922b-a6b3c85bce64 req-39033a63-1417-40c3-905f-385b7d4c3697 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:17.349764 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-269ae6dc-5810-44ca-922b-a6b3c85bce64 req-39033a63-1417-40c3-905f-385b7d4c3697 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:17.368334 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-a7e143d1-7f4f-458b-b151-9a98d48b9ae8 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:17.376317 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-a7e143d1-7f4f-458b-b151-9a98d48b9ae8 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1521 microversion: 2.1 time: 0.170867 Mar 31 18:15:17.379547 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.compute.server_external_events [req-269ae6dc-5810-44ca-922b-a6b3c85bce64 req-39033a63-1417-40c3-905f-385b7d4c3697 service nova] Creating event network-changed:b90b496d-8c4e-46bd-93a0-9e0e45bd14f0 for instance 6bcf99af-f089-4543-94c0-39ecee139bf7 on hv-cinder-maste Mar 31 18:15:17.383266 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 98/214] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:17 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1521 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:17.385369 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [req-269ae6dc-5810-44ca-922b-a6b3c85bce64 req-39033a63-1417-40c3-905f-385b7d4c3697 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054566 Mar 31 18:15:17.385952 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 117/215] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:15:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 31 18:15:17.683062 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-8e4c1e46-268e-41e6-b3cc-623ae537d672 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:17.683548 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-8e4c1e46-268e-41e6-b3cc-623ae537d672 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:17.689391 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-8e4c1e46-268e-41e6-b3cc-623ae537d672 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:17.689827 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-8e4c1e46-268e-41e6-b3cc-623ae537d672 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:17.690587 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-8e4c1e46-268e-41e6-b3cc-623ae537d672 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:17.691037 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-8e4c1e46-268e-41e6-b3cc-623ae537d672 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:17.714387 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-8e4c1e46-268e-41e6-b3cc-623ae537d672 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] Going to try to terminate instance {{(pid=117539) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 31 18:15:17.971853 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-5bfa99d0-f519-4bbd-b100-823b52d39071 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:17.972640 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-5bfa99d0-f519-4bbd-b100-823b52d39071 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] [instance: 6bcf99af-f089-4543-94c0-39ecee139bf7] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:17.979137 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-5bfa99d0-f519-4bbd-b100-823b52d39071 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:17.979583 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-5bfa99d0-f519-4bbd-b100-823b52d39071 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:17.980359 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-5bfa99d0-f519-4bbd-b100-823b52d39071 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:17.980790 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-5bfa99d0-f519-4bbd-b100-823b52d39071 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:18.077520 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-8e4c1e46-268e-41e6-b3cc-623ae537d672 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e" status: 204 len: 0 microversion: 2.1 time: 0.398028 Mar 31 18:15:18.078391 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 99/216] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Mar 31 18:15:17 2022] DELETE /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 31 18:15:18.087596 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-94b7f5d9-b14b-4828-a5c5-ac71a9383737 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:18.088279 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-94b7f5d9-b14b-4828-a5c5-ac71a9383737 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:18.093964 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-94b7f5d9-b14b-4828-a5c5-ac71a9383737 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:18.094393 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-94b7f5d9-b14b-4828-a5c5-ac71a9383737 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:18.095268 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-94b7f5d9-b14b-4828-a5c5-ac71a9383737 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:18.095852 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-94b7f5d9-b14b-4828-a5c5-ac71a9383737 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:18.121673 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-5bfa99d0-f519-4bbd-b100-823b52d39071 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be7ea3f86e04222ba3de78ec21b2b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b822e17d08cf49f79e8fd7faaa92a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:18.132145 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-5bfa99d0-f519-4bbd-b100-823b52d39071 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] 10.222.0.58 "GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7" status: 200 len: 1314 microversion: 2.1 time: 0.164404 Mar 31 18:15:18.142269 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 118/217] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:17 2022] GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7 => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:15:18.236748 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-94b7f5d9-b14b-4828-a5c5-ac71a9383737 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1dacde91404110b259cfab7a37bb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23366fa77e9049af8c183f6959cc158f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:18.245105 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-94b7f5d9-b14b-4828-a5c5-ac71a9383737 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] 10.222.0.58 "GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e" status: 200 len: 1552 microversion: 2.1 time: 0.162422 Mar 31 18:15:18.245666 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 100/218] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:18 2022] GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e => generated 1552 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:18.399784 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-43f9795c-b27c-4394-836f-6bcfd07bd669 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:18.400470 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-43f9795c-b27c-4394-836f-6bcfd07bd669 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:18.406594 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-43f9795c-b27c-4394-836f-6bcfd07bd669 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:18.407355 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-43f9795c-b27c-4394-836f-6bcfd07bd669 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:18.408121 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-43f9795c-b27c-4394-836f-6bcfd07bd669 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:18.408557 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-43f9795c-b27c-4394-836f-6bcfd07bd669 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:18.545321 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-43f9795c-b27c-4394-836f-6bcfd07bd669 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:18.552508 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-43f9795c-b27c-4394-836f-6bcfd07bd669 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1521 microversion: 2.1 time: 0.156789 Mar 31 18:15:18.553061 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 119/219] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:18 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:19.149193 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-866c48d9-9c5e-49c9-9a2b-bf45e122df02 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:19.149795 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-866c48d9-9c5e-49c9-9a2b-bf45e122df02 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] [instance: 6bcf99af-f089-4543-94c0-39ecee139bf7] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:19.155608 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-866c48d9-9c5e-49c9-9a2b-bf45e122df02 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:19.156033 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-866c48d9-9c5e-49c9-9a2b-bf45e122df02 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:19.157036 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-866c48d9-9c5e-49c9-9a2b-bf45e122df02 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:19.157467 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-866c48d9-9c5e-49c9-9a2b-bf45e122df02 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:19.262602 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-09490cd7-ed10-49b2-8582-10357ec2ec1c tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:19.263273 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-09490cd7-ed10-49b2-8582-10357ec2ec1c tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:19.269383 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-09490cd7-ed10-49b2-8582-10357ec2ec1c tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:19.269820 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-09490cd7-ed10-49b2-8582-10357ec2ec1c tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:19.270576 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-09490cd7-ed10-49b2-8582-10357ec2ec1c tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:19.271026 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-09490cd7-ed10-49b2-8582-10357ec2ec1c tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:19.297422 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-866c48d9-9c5e-49c9-9a2b-bf45e122df02 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be7ea3f86e04222ba3de78ec21b2b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b822e17d08cf49f79e8fd7faaa92a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:19.305381 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-866c48d9-9c5e-49c9-9a2b-bf45e122df02 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] 10.222.0.58 "GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7" status: 200 len: 1314 microversion: 2.1 time: 0.159939 Mar 31 18:15:19.306664 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 101/220] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:19 2022] GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7 => generated 1314 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:19.408773 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-09490cd7-ed10-49b2-8582-10357ec2ec1c tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1dacde91404110b259cfab7a37bb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23366fa77e9049af8c183f6959cc158f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:19.417286 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-09490cd7-ed10-49b2-8582-10357ec2ec1c tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] 10.222.0.58 "GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e" status: 200 len: 1552 microversion: 2.1 time: 0.158866 Mar 31 18:15:19.418050 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 120/221] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:19 2022] GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e => generated 1552 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:19.569451 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-bcaf7e9d-8786-4ae8-a448-e1c24f2f5484 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:19.570056 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-bcaf7e9d-8786-4ae8-a448-e1c24f2f5484 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:19.575829 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-bcaf7e9d-8786-4ae8-a448-e1c24f2f5484 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:19.576272 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-bcaf7e9d-8786-4ae8-a448-e1c24f2f5484 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:19.577018 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-bcaf7e9d-8786-4ae8-a448-e1c24f2f5484 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:19.577451 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-bcaf7e9d-8786-4ae8-a448-e1c24f2f5484 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:19.707537 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-bcaf7e9d-8786-4ae8-a448-e1c24f2f5484 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:19.715212 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-bcaf7e9d-8786-4ae8-a448-e1c24f2f5484 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1521 microversion: 2.1 time: 0.149783 Mar 31 18:15:19.715772 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 102/222] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:19 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:20.321743 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-43228699-05a0-4644-a1d6-615acb05378d tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:20.322379 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-43228699-05a0-4644-a1d6-615acb05378d tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] [instance: 6bcf99af-f089-4543-94c0-39ecee139bf7] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:20.328665 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-43228699-05a0-4644-a1d6-615acb05378d tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:20.329105 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-43228699-05a0-4644-a1d6-615acb05378d tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:20.329848 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-43228699-05a0-4644-a1d6-615acb05378d tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:20.330271 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-43228699-05a0-4644-a1d6-615acb05378d tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:20.434638 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-015505c0-89b9-42c4-a634-a9b21a2f50bc tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:20.435230 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-015505c0-89b9-42c4-a634-a9b21a2f50bc tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:20.441082 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-015505c0-89b9-42c4-a634-a9b21a2f50bc tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:20.441516 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-015505c0-89b9-42c4-a634-a9b21a2f50bc tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:20.442266 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-015505c0-89b9-42c4-a634-a9b21a2f50bc tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:20.442714 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-015505c0-89b9-42c4-a634-a9b21a2f50bc tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:20.464189 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-43228699-05a0-4644-a1d6-615acb05378d tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be7ea3f86e04222ba3de78ec21b2b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b822e17d08cf49f79e8fd7faaa92a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:20.471540 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-43228699-05a0-4644-a1d6-615acb05378d tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] 10.222.0.58 "GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7" status: 200 len: 1314 microversion: 2.1 time: 0.153556 Mar 31 18:15:20.472104 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 121/223] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:20 2022] GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:20.572009 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-015505c0-89b9-42c4-a634-a9b21a2f50bc tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1dacde91404110b259cfab7a37bb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23366fa77e9049af8c183f6959cc158f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:20.580603 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-015505c0-89b9-42c4-a634-a9b21a2f50bc tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] 10.222.0.58 "GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e" status: 200 len: 1552 microversion: 2.1 time: 0.150647 Mar 31 18:15:20.581457 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 103/224] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:20 2022] GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e => generated 1552 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:15:20.732697 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-2d244ffa-8ab3-4f44-ae8d-32e88185125e tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:20.733299 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-2d244ffa-8ab3-4f44-ae8d-32e88185125e tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:20.739337 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-2d244ffa-8ab3-4f44-ae8d-32e88185125e tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:20.739804 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-2d244ffa-8ab3-4f44-ae8d-32e88185125e tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:20.740571 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-2d244ffa-8ab3-4f44-ae8d-32e88185125e tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:20.741002 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-2d244ffa-8ab3-4f44-ae8d-32e88185125e tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:20.873830 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-2d244ffa-8ab3-4f44-ae8d-32e88185125e tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:20.881125 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-2d244ffa-8ab3-4f44-ae8d-32e88185125e tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1521 microversion: 2.1 time: 0.152370 Mar 31 18:15:20.881677 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 122/225] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:20 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:21.489273 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-3ccbc6d4-21a7-49b5-adb6-6151a103ffab tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:21.489873 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-3ccbc6d4-21a7-49b5-adb6-6151a103ffab tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] [instance: 6bcf99af-f089-4543-94c0-39ecee139bf7] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:21.495794 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3ccbc6d4-21a7-49b5-adb6-6151a103ffab tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:21.498730 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3ccbc6d4-21a7-49b5-adb6-6151a103ffab tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:21.498730 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3ccbc6d4-21a7-49b5-adb6-6151a103ffab tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:21.498730 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3ccbc6d4-21a7-49b5-adb6-6151a103ffab tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:21.598688 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-cdaa9526-9e4b-45c7-bcb4-5f9901ec439e tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:21.599970 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-cdaa9526-9e4b-45c7-bcb4-5f9901ec439e tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:21.606315 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-cdaa9526-9e4b-45c7-bcb4-5f9901ec439e tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:21.606799 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-cdaa9526-9e4b-45c7-bcb4-5f9901ec439e tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:21.607583 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-cdaa9526-9e4b-45c7-bcb4-5f9901ec439e tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:21.607998 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-cdaa9526-9e4b-45c7-bcb4-5f9901ec439e tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:21.633385 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-3ccbc6d4-21a7-49b5-adb6-6151a103ffab tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be7ea3f86e04222ba3de78ec21b2b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b822e17d08cf49f79e8fd7faaa92a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:21.641067 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-3ccbc6d4-21a7-49b5-adb6-6151a103ffab tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] 10.222.0.58 "GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7" status: 200 len: 1314 microversion: 2.1 time: 0.155640 Mar 31 18:15:21.641949 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 104/226] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:21 2022] GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:21.741100 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-cdaa9526-9e4b-45c7-bcb4-5f9901ec439e tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1dacde91404110b259cfab7a37bb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23366fa77e9049af8c183f6959cc158f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:21.748819 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-cdaa9526-9e4b-45c7-bcb4-5f9901ec439e tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] 10.222.0.58 "GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e" status: 200 len: 1552 microversion: 2.1 time: 0.154001 Mar 31 18:15:21.749386 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 123/227] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:21 2022] GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e => generated 1552 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:21.897197 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-4d8b0a6c-325a-4250-93a1-616b774f9852 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:21.898186 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-4d8b0a6c-325a-4250-93a1-616b774f9852 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:21.904103 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-4d8b0a6c-325a-4250-93a1-616b774f9852 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:21.904542 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-4d8b0a6c-325a-4250-93a1-616b774f9852 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:21.905334 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-4d8b0a6c-325a-4250-93a1-616b774f9852 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:21.905763 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-4d8b0a6c-325a-4250-93a1-616b774f9852 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:22.043487 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-4d8b0a6c-325a-4250-93a1-616b774f9852 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:22.050559 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-4d8b0a6c-325a-4250-93a1-616b774f9852 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1521 microversion: 2.1 time: 0.157217 Mar 31 18:15:22.051174 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 105/228] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:21 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:22.659219 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-69ac74ea-25dc-4cca-9dd9-0f61f705f21b tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:22.659850 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-69ac74ea-25dc-4cca-9dd9-0f61f705f21b tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] [instance: 6bcf99af-f089-4543-94c0-39ecee139bf7] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:22.666822 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-69ac74ea-25dc-4cca-9dd9-0f61f705f21b tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:22.667263 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-69ac74ea-25dc-4cca-9dd9-0f61f705f21b tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:22.668015 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-69ac74ea-25dc-4cca-9dd9-0f61f705f21b tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:22.668444 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-69ac74ea-25dc-4cca-9dd9-0f61f705f21b tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:22.767200 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-c7a13ef1-62aa-46a3-9bc7-8547cf20eb28 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:22.767999 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-c7a13ef1-62aa-46a3-9bc7-8547cf20eb28 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:22.776458 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c7a13ef1-62aa-46a3-9bc7-8547cf20eb28 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:22.776799 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c7a13ef1-62aa-46a3-9bc7-8547cf20eb28 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:22.777550 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c7a13ef1-62aa-46a3-9bc7-8547cf20eb28 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:22.777975 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c7a13ef1-62aa-46a3-9bc7-8547cf20eb28 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:22.804338 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-69ac74ea-25dc-4cca-9dd9-0f61f705f21b tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be7ea3f86e04222ba3de78ec21b2b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b822e17d08cf49f79e8fd7faaa92a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:22.812160 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-69ac74ea-25dc-4cca-9dd9-0f61f705f21b tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] 10.222.0.58 "GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7" status: 200 len: 1314 microversion: 2.1 time: 0.157016 Mar 31 18:15:22.812947 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 124/229] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:22 2022] GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:22.916384 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-c7a13ef1-62aa-46a3-9bc7-8547cf20eb28 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1dacde91404110b259cfab7a37bb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23366fa77e9049af8c183f6959cc158f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:22.924395 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-c7a13ef1-62aa-46a3-9bc7-8547cf20eb28 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] 10.222.0.58 "GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e" status: 200 len: 1552 microversion: 2.1 time: 0.162263 Mar 31 18:15:22.924955 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 106/230] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:22 2022] GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e => generated 1552 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:15:23.070111 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-fbe156c7-9bf5-48ca-98dd-50c50cdbfe0a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:23.071041 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-fbe156c7-9bf5-48ca-98dd-50c50cdbfe0a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:23.076821 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-fbe156c7-9bf5-48ca-98dd-50c50cdbfe0a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:23.077256 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-fbe156c7-9bf5-48ca-98dd-50c50cdbfe0a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:23.078018 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-fbe156c7-9bf5-48ca-98dd-50c50cdbfe0a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:23.078984 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-fbe156c7-9bf5-48ca-98dd-50c50cdbfe0a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:23.215738 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-fbe156c7-9bf5-48ca-98dd-50c50cdbfe0a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:23.222990 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-fbe156c7-9bf5-48ca-98dd-50c50cdbfe0a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1521 microversion: 2.1 time: 0.157555 Mar 31 18:15:23.223554 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 125/231] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:23 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:23.831034 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-4854538c-c290-449e-be0b-548c43a595f1 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:23.831771 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-4854538c-c290-449e-be0b-548c43a595f1 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] [instance: 6bcf99af-f089-4543-94c0-39ecee139bf7] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:23.837608 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-4854538c-c290-449e-be0b-548c43a595f1 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:23.838044 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-4854538c-c290-449e-be0b-548c43a595f1 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:23.839373 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-4854538c-c290-449e-be0b-548c43a595f1 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:23.839373 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-4854538c-c290-449e-be0b-548c43a595f1 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:23.946701 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-205ac892-c279-4508-9090-22afba99876e tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:23.947339 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-205ac892-c279-4508-9090-22afba99876e tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:23.957038 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-205ac892-c279-4508-9090-22afba99876e tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:23.957570 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-205ac892-c279-4508-9090-22afba99876e tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:23.958955 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-205ac892-c279-4508-9090-22afba99876e tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:23.960104 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-205ac892-c279-4508-9090-22afba99876e tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:24.041584 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-4854538c-c290-449e-be0b-548c43a595f1 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be7ea3f86e04222ba3de78ec21b2b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b822e17d08cf49f79e8fd7faaa92a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:24.049477 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-4854538c-c290-449e-be0b-548c43a595f1 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] 10.222.0.58 "GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7" status: 200 len: 1314 microversion: 2.1 time: 0.222588 Mar 31 18:15:24.060004 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 107/232] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:23 2022] GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:24.239720 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-a0e6b2c3-fcd6-45af-995d-4a1351bf783d tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:24.240317 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-a0e6b2c3-fcd6-45af-995d-4a1351bf783d tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:24.246520 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a0e6b2c3-fcd6-45af-995d-4a1351bf783d tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:24.246983 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a0e6b2c3-fcd6-45af-995d-4a1351bf783d tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:24.247729 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a0e6b2c3-fcd6-45af-995d-4a1351bf783d tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:24.248178 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a0e6b2c3-fcd6-45af-995d-4a1351bf783d tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:24.307948 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-205ac892-c279-4508-9090-22afba99876e tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1dacde91404110b259cfab7a37bb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23366fa77e9049af8c183f6959cc158f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:24.316502 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-205ac892-c279-4508-9090-22afba99876e tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] 10.222.0.58 "GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e" status: 200 len: 1552 microversion: 2.1 time: 0.374832 Mar 31 18:15:24.317167 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 126/233] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:23 2022] GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e => generated 1552 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:24.393814 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-a0e6b2c3-fcd6-45af-995d-4a1351bf783d tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:24.402468 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-a0e6b2c3-fcd6-45af-995d-4a1351bf783d tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1521 microversion: 2.1 time: 0.166580 Mar 31 18:15:24.406682 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 108/234] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:24 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1521 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:15:24.730754 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [req-1f0ea770-01b9-4b51-914f-d7ae6f04c5b4 req-70dda48e-7533-4d80-a3a7-88a51dcce228 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4a8079a-7824-4201-889b-a14d70024f7e", "name": "network-vif-deleted", "tag": "b41ca13e-f9fc-4896-a18b-4d8b90a0ef6b"}]} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:15:24.741688 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-1f0ea770-01b9-4b51-914f-d7ae6f04c5b4 req-70dda48e-7533-4d80-a3a7-88a51dcce228 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:24.742131 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-1f0ea770-01b9-4b51-914f-d7ae6f04c5b4 req-70dda48e-7533-4d80-a3a7-88a51dcce228 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:24.753090 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.compute.server_external_events [req-1f0ea770-01b9-4b51-914f-d7ae6f04c5b4 req-70dda48e-7533-4d80-a3a7-88a51dcce228 service nova] Creating event network-vif-deleted:b41ca13e-f9fc-4896-a18b-4d8b90a0ef6b for instance b4a8079a-7824-4201-889b-a14d70024f7e on hv-cinder-maste Mar 31 18:15:24.758635 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [req-1f0ea770-01b9-4b51-914f-d7ae6f04c5b4 req-70dda48e-7533-4d80-a3a7-88a51dcce228 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031687 Mar 31 18:15:24.759429 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 127/235] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:15:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:15:25.075577 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-2cc610b2-9936-4494-8c84-05655c784abd tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:25.076008 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-2cc610b2-9936-4494-8c84-05655c784abd tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] [instance: 6bcf99af-f089-4543-94c0-39ecee139bf7] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:25.081875 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-2cc610b2-9936-4494-8c84-05655c784abd tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:25.082311 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-2cc610b2-9936-4494-8c84-05655c784abd tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:25.083094 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-2cc610b2-9936-4494-8c84-05655c784abd tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:25.083550 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-2cc610b2-9936-4494-8c84-05655c784abd tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:25.227443 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-2cc610b2-9936-4494-8c84-05655c784abd tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be7ea3f86e04222ba3de78ec21b2b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b822e17d08cf49f79e8fd7faaa92a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:25.238633 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-2cc610b2-9936-4494-8c84-05655c784abd tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] 10.222.0.58 "GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7" status: 200 len: 1314 microversion: 2.1 time: 0.166921 Mar 31 18:15:25.239226 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 109/236] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:25 2022] GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7 => generated 1314 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:25.334977 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-53a4d04f-2960-466e-ba04-8510d71a566f tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:25.335834 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-53a4d04f-2960-466e-ba04-8510d71a566f tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:25.341840 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-53a4d04f-2960-466e-ba04-8510d71a566f tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:25.343820 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-53a4d04f-2960-466e-ba04-8510d71a566f tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:25.343820 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-53a4d04f-2960-466e-ba04-8510d71a566f tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:25.343820 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-53a4d04f-2960-466e-ba04-8510d71a566f tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:25.407618 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-53a4d04f-2960-466e-ba04-8510d71a566f tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1dacde91404110b259cfab7a37bb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23366fa77e9049af8c183f6959cc158f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:25.416509 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-53a4d04f-2960-466e-ba04-8510d71a566f tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] 10.222.0.58 "GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e" status: 200 len: 1345 microversion: 2.1 time: 0.086980 Mar 31 18:15:25.417076 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 128/237] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:25 2022] GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e => generated 1345 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:25.419745 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-5216ab01-2542-4274-90c2-7aca41454782 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:25.424028 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-5216ab01-2542-4274-90c2-7aca41454782 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:25.426457 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-5216ab01-2542-4274-90c2-7aca41454782 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:25.426920 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-5216ab01-2542-4274-90c2-7aca41454782 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:25.427675 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-5216ab01-2542-4274-90c2-7aca41454782 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:25.428730 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-5216ab01-2542-4274-90c2-7aca41454782 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:25.567922 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-5216ab01-2542-4274-90c2-7aca41454782 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:25.576740 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-5216ab01-2542-4274-90c2-7aca41454782 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1521 microversion: 2.1 time: 0.160856 Mar 31 18:15:25.577614 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 110/238] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:25 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:15:26.256129 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-6331d9d5-7c24-43eb-8c93-db4e31fd8ba9 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:26.256648 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-6331d9d5-7c24-43eb-8c93-db4e31fd8ba9 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] [instance: 6bcf99af-f089-4543-94c0-39ecee139bf7] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:26.262582 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6331d9d5-7c24-43eb-8c93-db4e31fd8ba9 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:26.263048 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6331d9d5-7c24-43eb-8c93-db4e31fd8ba9 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:26.263802 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6331d9d5-7c24-43eb-8c93-db4e31fd8ba9 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:26.264226 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6331d9d5-7c24-43eb-8c93-db4e31fd8ba9 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:26.402396 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-6331d9d5-7c24-43eb-8c93-db4e31fd8ba9 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be7ea3f86e04222ba3de78ec21b2b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b822e17d08cf49f79e8fd7faaa92a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:26.410137 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-6331d9d5-7c24-43eb-8c93-db4e31fd8ba9 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] 10.222.0.58 "GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7" status: 200 len: 1314 microversion: 2.1 time: 0.157935 Mar 31 18:15:26.410726 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 129/239] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:26 2022] GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:26.433414 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-387d4220-b6bb-43bc-8ba8-d1f62748e753 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:26.434016 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-387d4220-b6bb-43bc-8ba8-d1f62748e753 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:26.440137 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-387d4220-b6bb-43bc-8ba8-d1f62748e753 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:26.440637 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-387d4220-b6bb-43bc-8ba8-d1f62748e753 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:26.441453 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-387d4220-b6bb-43bc-8ba8-d1f62748e753 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:26.441902 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-387d4220-b6bb-43bc-8ba8-d1f62748e753 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:26.499552 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-387d4220-b6bb-43bc-8ba8-d1f62748e753 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1dacde91404110b259cfab7a37bb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23366fa77e9049af8c183f6959cc158f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:26.507248 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-387d4220-b6bb-43bc-8ba8-d1f62748e753 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] 10.222.0.58 "GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e" status: 200 len: 1345 microversion: 2.1 time: 0.077743 Mar 31 18:15:26.507740 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 111/240] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:26 2022] GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e => generated 1345 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:15:26.593804 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-2637101c-0196-47c1-b29e-8619c7726cb2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:26.594414 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-2637101c-0196-47c1-b29e-8619c7726cb2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:26.601708 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-2637101c-0196-47c1-b29e-8619c7726cb2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:26.602154 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-2637101c-0196-47c1-b29e-8619c7726cb2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:26.602943 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-2637101c-0196-47c1-b29e-8619c7726cb2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:26.603407 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-2637101c-0196-47c1-b29e-8619c7726cb2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:26.736331 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-2637101c-0196-47c1-b29e-8619c7726cb2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:26.751776 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-2637101c-0196-47c1-b29e-8619c7726cb2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1521 microversion: 2.1 time: 0.161737 Mar 31 18:15:26.752503 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 130/241] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:26 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1521 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:27.428319 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-c2424069-9426-479a-9724-29e39da42185 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:27.428932 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-c2424069-9426-479a-9724-29e39da42185 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] [instance: 6bcf99af-f089-4543-94c0-39ecee139bf7] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:27.434833 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c2424069-9426-479a-9724-29e39da42185 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:27.435433 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c2424069-9426-479a-9724-29e39da42185 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:27.436110 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c2424069-9426-479a-9724-29e39da42185 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:27.436609 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c2424069-9426-479a-9724-29e39da42185 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:27.525616 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-1f13d3d6-e888-498b-979a-850a8780a08f tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:27.526555 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-1f13d3d6-e888-498b-979a-850a8780a08f tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:27.533610 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-1f13d3d6-e888-498b-979a-850a8780a08f tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:27.534046 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-1f13d3d6-e888-498b-979a-850a8780a08f tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:27.534841 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-1f13d3d6-e888-498b-979a-850a8780a08f tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:27.535268 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-1f13d3d6-e888-498b-979a-850a8780a08f tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:27.571169 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-c2424069-9426-479a-9724-29e39da42185 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be7ea3f86e04222ba3de78ec21b2b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b822e17d08cf49f79e8fd7faaa92a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:27.578498 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-c2424069-9426-479a-9724-29e39da42185 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] 10.222.0.58 "GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7" status: 200 len: 1314 microversion: 2.1 time: 0.154687 Mar 31 18:15:27.579201 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 112/242] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:27 2022] GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:27.595517 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-1f13d3d6-e888-498b-979a-850a8780a08f tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1dacde91404110b259cfab7a37bb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23366fa77e9049af8c183f6959cc158f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:27.604592 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-1f13d3d6-e888-498b-979a-850a8780a08f tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] 10.222.0.58 "GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e" status: 200 len: 1345 microversion: 2.1 time: 0.084325 Mar 31 18:15:27.605283 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 131/243] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:27 2022] GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e => generated 1345 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:15:27.767963 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-670e9456-2408-4cb2-a9af-a2dfd0bb8c3c tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:27.768559 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-670e9456-2408-4cb2-a9af-a2dfd0bb8c3c tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:27.775345 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-670e9456-2408-4cb2-a9af-a2dfd0bb8c3c tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:27.775885 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-670e9456-2408-4cb2-a9af-a2dfd0bb8c3c tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:27.776664 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-670e9456-2408-4cb2-a9af-a2dfd0bb8c3c tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:27.777103 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-670e9456-2408-4cb2-a9af-a2dfd0bb8c3c tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:27.907618 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-670e9456-2408-4cb2-a9af-a2dfd0bb8c3c tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:27.915167 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-670e9456-2408-4cb2-a9af-a2dfd0bb8c3c tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1521 microversion: 2.1 time: 0.150988 Mar 31 18:15:27.915990 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 113/244] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:27 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:28.597958 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-5c56ba54-537a-43fc-88be-f30ddb375c20 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:28.599049 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-5c56ba54-537a-43fc-88be-f30ddb375c20 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] [instance: 6bcf99af-f089-4543-94c0-39ecee139bf7] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:28.607268 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-5c56ba54-537a-43fc-88be-f30ddb375c20 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:28.607711 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-5c56ba54-537a-43fc-88be-f30ddb375c20 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:28.608496 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-5c56ba54-537a-43fc-88be-f30ddb375c20 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:28.608977 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-5c56ba54-537a-43fc-88be-f30ddb375c20 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:28.622863 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-e2f1408b-fcdf-445f-949a-7b6b4d54849b tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:28.624044 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-e2f1408b-fcdf-445f-949a-7b6b4d54849b tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:28.630000 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e2f1408b-fcdf-445f-949a-7b6b4d54849b tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:28.630504 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e2f1408b-fcdf-445f-949a-7b6b4d54849b tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:28.631351 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e2f1408b-fcdf-445f-949a-7b6b4d54849b tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:28.631775 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e2f1408b-fcdf-445f-949a-7b6b4d54849b tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:28.690727 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-e2f1408b-fcdf-445f-949a-7b6b4d54849b tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1dacde91404110b259cfab7a37bb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23366fa77e9049af8c183f6959cc158f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:28.699192 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-e2f1408b-fcdf-445f-949a-7b6b4d54849b tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] 10.222.0.58 "GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e" status: 200 len: 1345 microversion: 2.1 time: 0.080404 Mar 31 18:15:28.699858 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 114/245] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:28 2022] GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e => generated 1345 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:28.747922 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-5c56ba54-537a-43fc-88be-f30ddb375c20 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be7ea3f86e04222ba3de78ec21b2b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b822e17d08cf49f79e8fd7faaa92a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:28.755150 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-5c56ba54-537a-43fc-88be-f30ddb375c20 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] 10.222.0.58 "GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7" status: 200 len: 1314 microversion: 2.1 time: 0.162932 Mar 31 18:15:28.755902 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 132/246] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:28 2022] GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:15:28.932217 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-55474886-b683-4c62-b515-165f95aa1922 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:28.932819 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-55474886-b683-4c62-b515-165f95aa1922 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:28.939186 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-55474886-b683-4c62-b515-165f95aa1922 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:28.939625 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-55474886-b683-4c62-b515-165f95aa1922 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:28.940369 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-55474886-b683-4c62-b515-165f95aa1922 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:28.940788 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-55474886-b683-4c62-b515-165f95aa1922 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:29.078245 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-55474886-b683-4c62-b515-165f95aa1922 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:29.086765 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-55474886-b683-4c62-b515-165f95aa1922 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1521 microversion: 2.1 time: 0.158280 Mar 31 18:15:29.087350 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 115/247] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:28 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:29.715680 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-bc8eabb1-df0d-454f-8096-c52d145c7937 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:29.716280 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-bc8eabb1-df0d-454f-8096-c52d145c7937 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:29.722447 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-bc8eabb1-df0d-454f-8096-c52d145c7937 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:29.722913 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-bc8eabb1-df0d-454f-8096-c52d145c7937 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:29.723660 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-bc8eabb1-df0d-454f-8096-c52d145c7937 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:29.724710 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-bc8eabb1-df0d-454f-8096-c52d145c7937 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:29.772639 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-9ee43296-505a-4acd-ac94-85d508d5489b tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:29.773231 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-9ee43296-505a-4acd-ac94-85d508d5489b tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] [instance: 6bcf99af-f089-4543-94c0-39ecee139bf7] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:29.779055 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9ee43296-505a-4acd-ac94-85d508d5489b tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:29.779486 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9ee43296-505a-4acd-ac94-85d508d5489b tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:29.780484 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9ee43296-505a-4acd-ac94-85d508d5489b tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:29.781189 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9ee43296-505a-4acd-ac94-85d508d5489b tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:29.783405 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-bc8eabb1-df0d-454f-8096-c52d145c7937 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1dacde91404110b259cfab7a37bb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23366fa77e9049af8c183f6959cc158f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:29.791204 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-bc8eabb1-df0d-454f-8096-c52d145c7937 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] 10.222.0.58 "GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e" status: 200 len: 1345 microversion: 2.1 time: 0.079293 Mar 31 18:15:29.791770 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 133/248] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:29 2022] GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e => generated 1345 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:29.913269 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-9ee43296-505a-4acd-ac94-85d508d5489b tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be7ea3f86e04222ba3de78ec21b2b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b822e17d08cf49f79e8fd7faaa92a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:29.920752 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-9ee43296-505a-4acd-ac94-85d508d5489b tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] 10.222.0.58 "GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7" status: 200 len: 1314 microversion: 2.1 time: 0.152524 Mar 31 18:15:29.921377 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 116/249] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:29 2022] GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:15:30.104854 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-3d85a3fa-186f-468c-a7ba-40a9ece22369 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:30.105543 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-3d85a3fa-186f-468c-a7ba-40a9ece22369 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:30.111852 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3d85a3fa-186f-468c-a7ba-40a9ece22369 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:30.112234 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3d85a3fa-186f-468c-a7ba-40a9ece22369 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:30.112995 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3d85a3fa-186f-468c-a7ba-40a9ece22369 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:30.113424 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3d85a3fa-186f-468c-a7ba-40a9ece22369 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:30.250693 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-3d85a3fa-186f-468c-a7ba-40a9ece22369 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:30.258494 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-3d85a3fa-186f-468c-a7ba-40a9ece22369 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1521 microversion: 2.1 time: 0.157695 Mar 31 18:15:30.259106 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 134/250] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:30 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:15:30.808677 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-3dfca6bf-ca2f-4afa-86f9-99df679ac7a9 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:30.809276 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-3dfca6bf-ca2f-4afa-86f9-99df679ac7a9 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:30.815275 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3dfca6bf-ca2f-4afa-86f9-99df679ac7a9 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:30.815720 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3dfca6bf-ca2f-4afa-86f9-99df679ac7a9 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:30.816473 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3dfca6bf-ca2f-4afa-86f9-99df679ac7a9 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:30.816901 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3dfca6bf-ca2f-4afa-86f9-99df679ac7a9 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:30.846844 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3dfca6bf-ca2f-4afa-86f9-99df679ac7a9 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:30.847290 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3dfca6bf-ca2f-4afa-86f9-99df679ac7a9 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:30.847748 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.objects.instance [None req-3dfca6bf-ca2f-4afa-86f9-99df679ac7a9 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lazy-loading 'fault' on Instance uuid b4a8079a-7824-4201-889b-a14d70024f7e {{(pid=117539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 31 18:15:30.893216 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-3dfca6bf-ca2f-4afa-86f9-99df679ac7a9 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ed1dacde91404110b259cfab7a37bb80', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '23366fa77e9049af8c183f6959cc158f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:30.901791 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-3dfca6bf-ca2f-4afa-86f9-99df679ac7a9 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] 10.222.0.58 "GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e" status: 200 len: 1350 microversion: 2.1 time: 0.097070 Mar 31 18:15:30.902335 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 117/251] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:30 2022] GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e => generated 1350 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:30.938120 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-6243df5a-998c-4416-9564-a1c6c6a4fc8e tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:30.938783 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-6243df5a-998c-4416-9564-a1c6c6a4fc8e tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] [instance: 6bcf99af-f089-4543-94c0-39ecee139bf7] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:30.944922 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6243df5a-998c-4416-9564-a1c6c6a4fc8e tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:30.945359 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6243df5a-998c-4416-9564-a1c6c6a4fc8e tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:30.946136 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6243df5a-998c-4416-9564-a1c6c6a4fc8e tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:30.946558 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6243df5a-998c-4416-9564-a1c6c6a4fc8e tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:31.104350 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-6243df5a-998c-4416-9564-a1c6c6a4fc8e tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be7ea3f86e04222ba3de78ec21b2b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b822e17d08cf49f79e8fd7faaa92a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:31.112732 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-6243df5a-998c-4416-9564-a1c6c6a4fc8e tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] 10.222.0.58 "GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7" status: 200 len: 1314 microversion: 2.1 time: 0.178448 Mar 31 18:15:31.113445 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 135/252] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:30 2022] GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7 => generated 1314 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:31.275696 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-e5f6d6b3-6f85-46d4-8c17-eaecf912a589 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:31.276305 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-e5f6d6b3-6f85-46d4-8c17-eaecf912a589 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:31.282404 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e5f6d6b3-6f85-46d4-8c17-eaecf912a589 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:31.284826 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e5f6d6b3-6f85-46d4-8c17-eaecf912a589 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:31.284826 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e5f6d6b3-6f85-46d4-8c17-eaecf912a589 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:31.284826 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e5f6d6b3-6f85-46d4-8c17-eaecf912a589 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:31.457690 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-e5f6d6b3-6f85-46d4-8c17-eaecf912a589 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:31.466555 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-e5f6d6b3-6f85-46d4-8c17-eaecf912a589 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1521 microversion: 2.1 time: 0.194940 Mar 31 18:15:31.469204 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 118/253] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:31 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:31.918756 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-14d70612-cd57-434b-98bb-2ab9d33a1f98 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:31.919356 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-14d70612-cd57-434b-98bb-2ab9d33a1f98 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:31.925203 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-14d70612-cd57-434b-98bb-2ab9d33a1f98 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:31.925665 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-14d70612-cd57-434b-98bb-2ab9d33a1f98 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:31.926408 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-14d70612-cd57-434b-98bb-2ab9d33a1f98 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:31.927133 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-14d70612-cd57-434b-98bb-2ab9d33a1f98 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:31.939670 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.wsgi [None req-14d70612-cd57-434b-98bb-2ab9d33a1f98 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] HTTP exception thrown: Instance b4a8079a-7824-4201-889b-a14d70024f7e could not be found. Mar 31 18:15:31.940247 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-14d70612-cd57-434b-98bb-2ab9d33a1f98 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Returning 404 to user: Instance b4a8079a-7824-4201-889b-a14d70024f7e could not be found. {{(pid=117538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:15:31.941014 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-14d70612-cd57-434b-98bb-2ab9d33a1f98 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] 10.222.0.58 "GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e" status: 404 len: 111 microversion: 2.1 time: 0.026075 Mar 31 18:15:31.941552 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 136/254] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:31 2022] GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 31 18:15:32.046162 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-a9c5944b-00c4-4d8c-8f4e-6e838b1eb0a2 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:32.047218 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-a9c5944b-00c4-4d8c-8f4e-6e838b1eb0a2 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:32.053951 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a9c5944b-00c4-4d8c-8f4e-6e838b1eb0a2 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:32.054393 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a9c5944b-00c4-4d8c-8f4e-6e838b1eb0a2 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:32.055188 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a9c5944b-00c4-4d8c-8f4e-6e838b1eb0a2 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:32.055616 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a9c5944b-00c4-4d8c-8f4e-6e838b1eb0a2 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:32.069438 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.wsgi [None req-a9c5944b-00c4-4d8c-8f4e-6e838b1eb0a2 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] HTTP exception thrown: Instance b4a8079a-7824-4201-889b-a14d70024f7e could not be found. Mar 31 18:15:32.070096 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-a9c5944b-00c4-4d8c-8f4e-6e838b1eb0a2 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Returning 404 to user: Instance b4a8079a-7824-4201-889b-a14d70024f7e could not be found. {{(pid=117539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:15:32.070941 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-a9c5944b-00c4-4d8c-8f4e-6e838b1eb0a2 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] 10.222.0.58 "GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.029019 Mar 31 18:15:32.071491 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 119/255] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Mar 31 18:15:32 2022] GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e/os-volume_attachments => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 31 18:15:32.131071 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-4a141816-7ef6-489a-be4e-ab2da549b38a tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:32.131673 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-4a141816-7ef6-489a-be4e-ab2da549b38a tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] [instance: 6bcf99af-f089-4543-94c0-39ecee139bf7] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:32.138116 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4a141816-7ef6-489a-be4e-ab2da549b38a tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:32.138553 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4a141816-7ef6-489a-be4e-ab2da549b38a tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:32.139318 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4a141816-7ef6-489a-be4e-ab2da549b38a tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:32.139745 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4a141816-7ef6-489a-be4e-ab2da549b38a tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:32.275535 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-4a141816-7ef6-489a-be4e-ab2da549b38a tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be7ea3f86e04222ba3de78ec21b2b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b822e17d08cf49f79e8fd7faaa92a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:32.283149 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-4a141816-7ef6-489a-be4e-ab2da549b38a tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] 10.222.0.58 "GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7" status: 200 len: 1314 microversion: 2.1 time: 0.156510 Mar 31 18:15:32.283715 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 137/256] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:32 2022] GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:32.484110 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-b8e34992-beff-4a17-9dcc-11d9219c19d2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:32.484741 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-b8e34992-beff-4a17-9dcc-11d9219c19d2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:32.491307 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b8e34992-beff-4a17-9dcc-11d9219c19d2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:32.491765 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b8e34992-beff-4a17-9dcc-11d9219c19d2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:32.492500 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b8e34992-beff-4a17-9dcc-11d9219c19d2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:32.492932 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b8e34992-beff-4a17-9dcc-11d9219c19d2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:32.620334 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-b8e34992-beff-4a17-9dcc-11d9219c19d2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:32.627503 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-b8e34992-beff-4a17-9dcc-11d9219c19d2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1521 microversion: 2.1 time: 0.147216 Mar 31 18:15:32.628071 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 120/257] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:32 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1521 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:33.301330 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-47571724-d4a1-4587-89ed-fea70aa615ea tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:33.301989 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-47571724-d4a1-4587-89ed-fea70aa615ea tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] [instance: 6bcf99af-f089-4543-94c0-39ecee139bf7] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:33.308225 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-47571724-d4a1-4587-89ed-fea70aa615ea tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:33.308662 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-47571724-d4a1-4587-89ed-fea70aa615ea tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:33.309411 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-47571724-d4a1-4587-89ed-fea70aa615ea tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:33.309837 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-47571724-d4a1-4587-89ed-fea70aa615ea tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:33.447484 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-47571724-d4a1-4587-89ed-fea70aa615ea tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be7ea3f86e04222ba3de78ec21b2b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b822e17d08cf49f79e8fd7faaa92a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:33.454915 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-47571724-d4a1-4587-89ed-fea70aa615ea tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] 10.222.0.58 "GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7" status: 200 len: 1314 microversion: 2.1 time: 0.157611 Mar 31 18:15:33.455644 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 138/258] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:33 2022] GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7 => generated 1314 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:33.644377 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-fab1887d-d25a-492b-a91b-7a9aeb708e14 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:33.645007 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-fab1887d-d25a-492b-a91b-7a9aeb708e14 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:33.651560 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-fab1887d-d25a-492b-a91b-7a9aeb708e14 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:33.651998 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-fab1887d-d25a-492b-a91b-7a9aeb708e14 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:33.652757 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-fab1887d-d25a-492b-a91b-7a9aeb708e14 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:33.653182 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-fab1887d-d25a-492b-a91b-7a9aeb708e14 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:33.685308 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [req-6ec31626-fc93-4deb-835e-0fd4abbe47f2 req-57bfc68c-e381-4cf2-9c63-f4029648e48d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bcf99af-f089-4543-94c0-39ecee139bf7", "name": "network-vif-plugged", "status": "completed", "tag": "b90b496d-8c4e-46bd-93a0-9e0e45bd14f0"}]} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:15:33.695935 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-6ec31626-fc93-4deb-835e-0fd4abbe47f2 req-57bfc68c-e381-4cf2-9c63-f4029648e48d service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:33.696380 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-6ec31626-fc93-4deb-835e-0fd4abbe47f2 req-57bfc68c-e381-4cf2-9c63-f4029648e48d service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:33.708451 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.compute.server_external_events [req-6ec31626-fc93-4deb-835e-0fd4abbe47f2 req-57bfc68c-e381-4cf2-9c63-f4029648e48d service nova] Creating event network-vif-plugged:b90b496d-8c4e-46bd-93a0-9e0e45bd14f0 for instance 6bcf99af-f089-4543-94c0-39ecee139bf7 on hv-cinder-maste Mar 31 18:15:33.714520 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [req-6ec31626-fc93-4deb-835e-0fd4abbe47f2 req-57bfc68c-e381-4cf2-9c63-f4029648e48d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032933 Mar 31 18:15:33.715066 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 139/259] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:15:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 31 18:15:33.795480 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-fab1887d-d25a-492b-a91b-7a9aeb708e14 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:33.803653 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-fab1887d-d25a-492b-a91b-7a9aeb708e14 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1521 microversion: 2.1 time: 0.163224 Mar 31 18:15:33.804213 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 121/260] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:33 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1521 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:34.472739 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-078c96a1-33aa-4bcd-ad24-7edf3b14455e tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:34.473651 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-078c96a1-33aa-4bcd-ad24-7edf3b14455e tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] [instance: 6bcf99af-f089-4543-94c0-39ecee139bf7] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:34.480094 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-078c96a1-33aa-4bcd-ad24-7edf3b14455e tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:34.480530 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-078c96a1-33aa-4bcd-ad24-7edf3b14455e tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:34.481284 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-078c96a1-33aa-4bcd-ad24-7edf3b14455e tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:34.481702 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-078c96a1-33aa-4bcd-ad24-7edf3b14455e tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:34.614846 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-078c96a1-33aa-4bcd-ad24-7edf3b14455e tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be7ea3f86e04222ba3de78ec21b2b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b822e17d08cf49f79e8fd7faaa92a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:34.622088 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-078c96a1-33aa-4bcd-ad24-7edf3b14455e tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] 10.222.0.58 "GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7" status: 200 len: 1314 microversion: 2.1 time: 0.153655 Mar 31 18:15:34.622663 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 140/261] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:34 2022] GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:34.821092 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-d0052882-fbcf-4db3-a41a-b7b0ffe03743 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:34.821698 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-d0052882-fbcf-4db3-a41a-b7b0ffe03743 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:34.827632 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-d0052882-fbcf-4db3-a41a-b7b0ffe03743 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:34.828072 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-d0052882-fbcf-4db3-a41a-b7b0ffe03743 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:34.828828 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-d0052882-fbcf-4db3-a41a-b7b0ffe03743 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:34.829262 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-d0052882-fbcf-4db3-a41a-b7b0ffe03743 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:34.965682 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-d0052882-fbcf-4db3-a41a-b7b0ffe03743 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:34.973738 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-d0052882-fbcf-4db3-a41a-b7b0ffe03743 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1521 microversion: 2.1 time: 0.157234 Mar 31 18:15:34.974396 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 122/262] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:34 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:35.639861 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-58c6d3e9-2a5a-405d-87e8-57f44a1d8030 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:35.640545 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-58c6d3e9-2a5a-405d-87e8-57f44a1d8030 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] [instance: 6bcf99af-f089-4543-94c0-39ecee139bf7] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:35.647166 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-58c6d3e9-2a5a-405d-87e8-57f44a1d8030 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:35.647661 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-58c6d3e9-2a5a-405d-87e8-57f44a1d8030 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:35.648453 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-58c6d3e9-2a5a-405d-87e8-57f44a1d8030 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:35.648921 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-58c6d3e9-2a5a-405d-87e8-57f44a1d8030 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:35.786661 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-58c6d3e9-2a5a-405d-87e8-57f44a1d8030 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be7ea3f86e04222ba3de78ec21b2b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b822e17d08cf49f79e8fd7faaa92a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:35.794557 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-58c6d3e9-2a5a-405d-87e8-57f44a1d8030 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] 10.222.0.58 "GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7" status: 200 len: 1314 microversion: 2.1 time: 0.158562 Mar 31 18:15:35.795216 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 141/263] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:35 2022] GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7 => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:35.993144 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-3e190d07-ed4b-4642-888b-97419dce1676 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:35.993756 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-3e190d07-ed4b-4642-888b-97419dce1676 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:35.999585 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3e190d07-ed4b-4642-888b-97419dce1676 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:36.000020 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3e190d07-ed4b-4642-888b-97419dce1676 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:36.000901 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3e190d07-ed4b-4642-888b-97419dce1676 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:36.001227 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3e190d07-ed4b-4642-888b-97419dce1676 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:36.159392 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-3e190d07-ed4b-4642-888b-97419dce1676 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:36.167399 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-3e190d07-ed4b-4642-888b-97419dce1676 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1521 microversion: 2.1 time: 0.180727 Mar 31 18:15:36.167995 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 123/264] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:35 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:36.812808 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-ca0c5f8e-9919-42ef-b36c-0fc9c06f7d28 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:36.813534 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-ca0c5f8e-9919-42ef-b36c-0fc9c06f7d28 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] [instance: 6bcf99af-f089-4543-94c0-39ecee139bf7] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:36.820000 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-ca0c5f8e-9919-42ef-b36c-0fc9c06f7d28 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:36.820423 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-ca0c5f8e-9919-42ef-b36c-0fc9c06f7d28 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:36.821277 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-ca0c5f8e-9919-42ef-b36c-0fc9c06f7d28 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:36.821707 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-ca0c5f8e-9919-42ef-b36c-0fc9c06f7d28 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:37.031534 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-ca0c5f8e-9919-42ef-b36c-0fc9c06f7d28 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be7ea3f86e04222ba3de78ec21b2b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b822e17d08cf49f79e8fd7faaa92a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:37.038254 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-ca0c5f8e-9919-42ef-b36c-0fc9c06f7d28 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] 10.222.0.58 "GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7" status: 200 len: 1314 microversion: 2.1 time: 0.229358 Mar 31 18:15:37.042079 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 142/265] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:36 2022] GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:37.184827 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-21d91822-8a95-45ef-b408-d700f3fac46c tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:37.185577 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-21d91822-8a95-45ef-b408-d700f3fac46c tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:37.191366 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-21d91822-8a95-45ef-b408-d700f3fac46c tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:37.192377 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-21d91822-8a95-45ef-b408-d700f3fac46c tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:37.193381 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-21d91822-8a95-45ef-b408-d700f3fac46c tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:37.193811 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-21d91822-8a95-45ef-b408-d700f3fac46c tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:37.327255 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-21d91822-8a95-45ef-b408-d700f3fac46c tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:37.337388 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-21d91822-8a95-45ef-b408-d700f3fac46c tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1521 microversion: 2.1 time: 0.156342 Mar 31 18:15:37.338156 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 124/266] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:37 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1521 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:37.710247 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-dbe2cc4b-1dbe-4142-9606-59365f663423 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:37.710758 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-dbe2cc4b-1dbe-4142-9606-59365f663423 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:37.716752 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-dbe2cc4b-1dbe-4142-9606-59365f663423 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:37.717368 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-dbe2cc4b-1dbe-4142-9606-59365f663423 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:37.718130 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-dbe2cc4b-1dbe-4142-9606-59365f663423 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:37.718559 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-dbe2cc4b-1dbe-4142-9606-59365f663423 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:37.731950 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.wsgi [None req-dbe2cc4b-1dbe-4142-9606-59365f663423 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] HTTP exception thrown: Instance b4a8079a-7824-4201-889b-a14d70024f7e could not be found. Mar 31 18:15:37.732547 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-dbe2cc4b-1dbe-4142-9606-59365f663423 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Returning 404 to user: Instance b4a8079a-7824-4201-889b-a14d70024f7e could not be found. {{(pid=117538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:15:37.733362 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-dbe2cc4b-1dbe-4142-9606-59365f663423 tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] 10.222.0.58 "DELETE /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e" status: 404 len: 111 microversion: 2.1 time: 0.027493 Mar 31 18:15:37.733907 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 143/267] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Mar 31 18:15:37 2022] DELETE /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 31 18:15:37.741888 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-c8cde2be-4be2-4fb0-94f6-4751d81ed7fd tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:37.743005 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-c8cde2be-4be2-4fb0-94f6-4751d81ed7fd tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] [instance: b4a8079a-7824-4201-889b-a14d70024f7e] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:37.748760 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c8cde2be-4be2-4fb0-94f6-4751d81ed7fd tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:37.757659 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c8cde2be-4be2-4fb0-94f6-4751d81ed7fd tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:37.757659 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c8cde2be-4be2-4fb0-94f6-4751d81ed7fd tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:37.757659 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c8cde2be-4be2-4fb0-94f6-4751d81ed7fd tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:37.763509 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.wsgi [None req-c8cde2be-4be2-4fb0-94f6-4751d81ed7fd tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] HTTP exception thrown: Instance b4a8079a-7824-4201-889b-a14d70024f7e could not be found. Mar 31 18:15:37.764102 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-c8cde2be-4be2-4fb0-94f6-4751d81ed7fd tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] Returning 404 to user: Instance b4a8079a-7824-4201-889b-a14d70024f7e could not be found. {{(pid=117539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:15:37.765109 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-c8cde2be-4be2-4fb0-94f6-4751d81ed7fd tempest-DeleteServersTestJSON-523899073 tempest-DeleteServersTestJSON-523899073-project] 10.222.0.58 "GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e" status: 404 len: 111 microversion: 2.1 time: 0.027131 Mar 31 18:15:37.765771 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 125/268] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:37 2022] GET /compute/v2.1/servers/b4a8079a-7824-4201-889b-a14d70024f7e => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 31 18:15:38.068728 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-a031c4b1-981c-4c6e-81ac-04f0c42f028f tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:38.069354 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-a031c4b1-981c-4c6e-81ac-04f0c42f028f tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] [instance: 6bcf99af-f089-4543-94c0-39ecee139bf7] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:38.077128 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a031c4b1-981c-4c6e-81ac-04f0c42f028f tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:38.079941 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a031c4b1-981c-4c6e-81ac-04f0c42f028f tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:38.081011 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a031c4b1-981c-4c6e-81ac-04f0c42f028f tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:38.081655 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a031c4b1-981c-4c6e-81ac-04f0c42f028f tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:38.252143 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-a031c4b1-981c-4c6e-81ac-04f0c42f028f tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be7ea3f86e04222ba3de78ec21b2b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b822e17d08cf49f79e8fd7faaa92a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:38.255294 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-a031c4b1-981c-4c6e-81ac-04f0c42f028f tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] 10.222.0.58 "GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7" status: 200 len: 1314 microversion: 2.1 time: 0.202348 Mar 31 18:15:38.256053 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 144/269] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:38 2022] GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7 => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:38.354797 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-97189aef-08cb-4d4b-ba01-b2c0c8bcae02 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:38.355596 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-97189aef-08cb-4d4b-ba01-b2c0c8bcae02 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:38.361387 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-97189aef-08cb-4d4b-ba01-b2c0c8bcae02 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:38.361850 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-97189aef-08cb-4d4b-ba01-b2c0c8bcae02 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:38.362685 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-97189aef-08cb-4d4b-ba01-b2c0c8bcae02 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:38.363245 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-97189aef-08cb-4d4b-ba01-b2c0c8bcae02 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:38.727474 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-97189aef-08cb-4d4b-ba01-b2c0c8bcae02 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:38.735363 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-97189aef-08cb-4d4b-ba01-b2c0c8bcae02 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1501 microversion: 2.1 time: 0.384563 Mar 31 18:15:38.735987 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 126/270] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:38 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1501 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:38.755842 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-7afe2420-3a52-4c75-b79e-4b598f76ff1c tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:38.756636 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-7afe2420-3a52-4c75-b79e-4b598f76ff1c tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 779c13cd-7a7a-47b4-b488-0d1e365c3dc4] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:38.762857 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-7afe2420-3a52-4c75-b79e-4b598f76ff1c tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:38.763365 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-7afe2420-3a52-4c75-b79e-4b598f76ff1c tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:38.764712 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-7afe2420-3a52-4c75-b79e-4b598f76ff1c tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:38.765853 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-7afe2420-3a52-4c75-b79e-4b598f76ff1c tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:38.961473 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-7afe2420-3a52-4c75-b79e-4b598f76ff1c tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:38.971600 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-7afe2420-3a52-4c75-b79e-4b598f76ff1c tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4" status: 200 len: 1514 microversion: 2.1 time: 0.221028 Mar 31 18:15:38.974755 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 145/271] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:38 2022] GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4 => generated 1514 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:39.275233 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-945afc72-187b-421e-b8a7-24ae29aeb219 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:39.275842 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-945afc72-187b-421e-b8a7-24ae29aeb219 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] [instance: 6bcf99af-f089-4543-94c0-39ecee139bf7] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:39.283358 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-945afc72-187b-421e-b8a7-24ae29aeb219 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:39.283939 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-945afc72-187b-421e-b8a7-24ae29aeb219 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:39.286643 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-945afc72-187b-421e-b8a7-24ae29aeb219 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:39.288574 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-945afc72-187b-421e-b8a7-24ae29aeb219 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:39.449740 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-945afc72-187b-421e-b8a7-24ae29aeb219 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be7ea3f86e04222ba3de78ec21b2b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b822e17d08cf49f79e8fd7faaa92a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:39.458801 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-945afc72-187b-421e-b8a7-24ae29aeb219 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] 10.222.0.58 "GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7" status: 200 len: 1314 microversion: 2.1 time: 0.189627 Mar 31 18:15:39.459476 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 127/272] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:39 2022] GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:40.477360 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-e89f0960-3d14-42d6-8a58-bc01d2dcf4f6 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:40.478123 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-e89f0960-3d14-42d6-8a58-bc01d2dcf4f6 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] [instance: 6bcf99af-f089-4543-94c0-39ecee139bf7] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:40.484844 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e89f0960-3d14-42d6-8a58-bc01d2dcf4f6 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:40.485287 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e89f0960-3d14-42d6-8a58-bc01d2dcf4f6 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:40.486040 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e89f0960-3d14-42d6-8a58-bc01d2dcf4f6 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:40.486464 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e89f0960-3d14-42d6-8a58-bc01d2dcf4f6 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:40.628077 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-e89f0960-3d14-42d6-8a58-bc01d2dcf4f6 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be7ea3f86e04222ba3de78ec21b2b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b822e17d08cf49f79e8fd7faaa92a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:40.636126 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-e89f0960-3d14-42d6-8a58-bc01d2dcf4f6 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] 10.222.0.58 "GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7" status: 200 len: 1463 microversion: 2.1 time: 0.164261 Mar 31 18:15:40.636770 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 146/273] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:40 2022] GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7 => generated 1463 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:40.678564 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-e10b9cb2-4cdd-4c09-8379-77337553f826 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:40.679124 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-e10b9cb2-4cdd-4c09-8379-77337553f826 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] [instance: 6bcf99af-f089-4543-94c0-39ecee139bf7] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:40.685089 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e10b9cb2-4cdd-4c09-8379-77337553f826 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:40.685582 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e10b9cb2-4cdd-4c09-8379-77337553f826 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:40.686533 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e10b9cb2-4cdd-4c09-8379-77337553f826 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:40.686998 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e10b9cb2-4cdd-4c09-8379-77337553f826 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:40.720506 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-e10b9cb2-4cdd-4c09-8379-77337553f826 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] [instance: 6bcf99af-f089-4543-94c0-39ecee139bf7] Going to try to terminate instance {{(pid=117539) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 31 18:15:41.225535 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-e10b9cb2-4cdd-4c09-8379-77337553f826 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] 10.222.0.58 "DELETE /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7" status: 204 len: 0 microversion: 2.1 time: 0.551109 Mar 31 18:15:41.227693 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 128/274] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Mar 31 18:15:40 2022] DELETE /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7 => generated 0 bytes in 553 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 31 18:15:41.241829 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-8a1b73e5-74d8-4c1a-95de-95ff5fb1c0cc tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:41.242684 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-8a1b73e5-74d8-4c1a-95de-95ff5fb1c0cc tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] [instance: 6bcf99af-f089-4543-94c0-39ecee139bf7] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:41.248885 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8a1b73e5-74d8-4c1a-95de-95ff5fb1c0cc tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:41.249415 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8a1b73e5-74d8-4c1a-95de-95ff5fb1c0cc tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:41.250265 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8a1b73e5-74d8-4c1a-95de-95ff5fb1c0cc tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:41.250799 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8a1b73e5-74d8-4c1a-95de-95ff5fb1c0cc tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:41.413791 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-8a1b73e5-74d8-4c1a-95de-95ff5fb1c0cc tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be7ea3f86e04222ba3de78ec21b2b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b822e17d08cf49f79e8fd7faaa92a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:41.421727 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-8a1b73e5-74d8-4c1a-95de-95ff5fb1c0cc tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] 10.222.0.58 "GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7" status: 200 len: 1469 microversion: 2.1 time: 0.183801 Mar 31 18:15:41.422713 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 147/275] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:41 2022] GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7 => generated 1469 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:42.440466 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-89e8f5f9-d75a-4c4a-af91-7671d63395a4 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:42.441976 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-89e8f5f9-d75a-4c4a-af91-7671d63395a4 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] [instance: 6bcf99af-f089-4543-94c0-39ecee139bf7] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:42.447535 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-89e8f5f9-d75a-4c4a-af91-7671d63395a4 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:42.447965 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-89e8f5f9-d75a-4c4a-af91-7671d63395a4 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:42.448714 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-89e8f5f9-d75a-4c4a-af91-7671d63395a4 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:42.449136 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-89e8f5f9-d75a-4c4a-af91-7671d63395a4 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:42.632043 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-89e8f5f9-d75a-4c4a-af91-7671d63395a4 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be7ea3f86e04222ba3de78ec21b2b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b822e17d08cf49f79e8fd7faaa92a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:42.643084 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-89e8f5f9-d75a-4c4a-af91-7671d63395a4 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] 10.222.0.58 "GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7" status: 200 len: 1469 microversion: 2.1 time: 0.203427 Mar 31 18:15:42.643084 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 129/276] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:42 2022] GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7 => generated 1469 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:43.657527 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-72d330bf-4e4b-4d47-9291-ffdfb7d71752 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:43.659561 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-72d330bf-4e4b-4d47-9291-ffdfb7d71752 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] [instance: 6bcf99af-f089-4543-94c0-39ecee139bf7] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:43.665080 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-72d330bf-4e4b-4d47-9291-ffdfb7d71752 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:43.665526 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-72d330bf-4e4b-4d47-9291-ffdfb7d71752 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:43.666289 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-72d330bf-4e4b-4d47-9291-ffdfb7d71752 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:43.666750 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-72d330bf-4e4b-4d47-9291-ffdfb7d71752 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:43.821870 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-72d330bf-4e4b-4d47-9291-ffdfb7d71752 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be7ea3f86e04222ba3de78ec21b2b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b822e17d08cf49f79e8fd7faaa92a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:43.829324 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-72d330bf-4e4b-4d47-9291-ffdfb7d71752 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] 10.222.0.58 "GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7" status: 200 len: 1469 microversion: 2.1 time: 0.175956 Mar 31 18:15:43.830080 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 148/277] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:43 2022] GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7 => generated 1469 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:44.847339 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-b5936708-0794-4946-8ce4-daf8640c8e4c tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:44.847950 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-b5936708-0794-4946-8ce4-daf8640c8e4c tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] [instance: 6bcf99af-f089-4543-94c0-39ecee139bf7] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:44.854024 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b5936708-0794-4946-8ce4-daf8640c8e4c tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:44.854468 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b5936708-0794-4946-8ce4-daf8640c8e4c tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:44.855283 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b5936708-0794-4946-8ce4-daf8640c8e4c tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:44.855722 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b5936708-0794-4946-8ce4-daf8640c8e4c tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:45.004727 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-b5936708-0794-4946-8ce4-daf8640c8e4c tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be7ea3f86e04222ba3de78ec21b2b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b822e17d08cf49f79e8fd7faaa92a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:45.012028 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-b5936708-0794-4946-8ce4-daf8640c8e4c tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] 10.222.0.58 "GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7" status: 200 len: 1469 microversion: 2.1 time: 0.169350 Mar 31 18:15:45.012945 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 130/278] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:44 2022] GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7 => generated 1469 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:46.033413 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-bd96bfe4-3bb1-4e25-9bfe-f9ac04e25b83 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:46.034129 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-bd96bfe4-3bb1-4e25-9bfe-f9ac04e25b83 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] [instance: 6bcf99af-f089-4543-94c0-39ecee139bf7] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:46.040079 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-bd96bfe4-3bb1-4e25-9bfe-f9ac04e25b83 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:46.040524 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-bd96bfe4-3bb1-4e25-9bfe-f9ac04e25b83 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:46.041282 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-bd96bfe4-3bb1-4e25-9bfe-f9ac04e25b83 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:46.041717 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-bd96bfe4-3bb1-4e25-9bfe-f9ac04e25b83 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:46.195648 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-bd96bfe4-3bb1-4e25-9bfe-f9ac04e25b83 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be7ea3f86e04222ba3de78ec21b2b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b822e17d08cf49f79e8fd7faaa92a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:46.203472 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-bd96bfe4-3bb1-4e25-9bfe-f9ac04e25b83 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] 10.222.0.58 "GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7" status: 200 len: 1469 microversion: 2.1 time: 0.174505 Mar 31 18:15:46.204029 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 149/279] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:46 2022] GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7 => generated 1469 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:47.221078 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-ca481c8d-4a5d-4033-bc8c-2faa5c4f3cef tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:47.221680 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-ca481c8d-4a5d-4033-bc8c-2faa5c4f3cef tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] [instance: 6bcf99af-f089-4543-94c0-39ecee139bf7] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:47.227382 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ca481c8d-4a5d-4033-bc8c-2faa5c4f3cef tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:47.227817 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ca481c8d-4a5d-4033-bc8c-2faa5c4f3cef tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:47.228563 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ca481c8d-4a5d-4033-bc8c-2faa5c4f3cef tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:47.228998 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ca481c8d-4a5d-4033-bc8c-2faa5c4f3cef tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:47.366824 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-ca481c8d-4a5d-4033-bc8c-2faa5c4f3cef tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be7ea3f86e04222ba3de78ec21b2b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b822e17d08cf49f79e8fd7faaa92a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:47.371052 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-ca481c8d-4a5d-4033-bc8c-2faa5c4f3cef tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] 10.222.0.58 "GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7" status: 200 len: 1469 microversion: 2.1 time: 0.153708 Mar 31 18:15:47.371631 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 131/280] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:47 2022] GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7 => generated 1469 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:47.550627 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-93b8dc3d-01bd-4b44-904b-c74f7741c246 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:15:47.551624 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-93b8dc3d-01bd-4b44-904b-c74f7741c246 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 779c13cd-7a7a-47b4-b488-0d1e365c3dc4] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:47.559120 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-93b8dc3d-01bd-4b44-904b-c74f7741c246 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:47.559568 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-93b8dc3d-01bd-4b44-904b-c74f7741c246 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:47.561500 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-93b8dc3d-01bd-4b44-904b-c74f7741c246 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:47.561953 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-93b8dc3d-01bd-4b44-904b-c74f7741c246 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:47.604333 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.objects.instance [None req-93b8dc3d-01bd-4b44-904b-c74f7741c246 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lazy-loading 'flavor' on Instance uuid 779c13cd-7a7a-47b4-b488-0d1e365c3dc4 {{(pid=117538) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 31 18:15:47.967731 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-93b8dc3d-01bd-4b44-904b-c74f7741c246 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "POST /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4/action" status: 200 len: 32 microversion: 2.1 time: 0.422294 Mar 31 18:15:47.968330 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 150/281] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Mar 31 18:15:47 2022] POST /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4/action => generated 32 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Mar 31 18:15:47.978289 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-0e8c0bf7-5fdf-4d31-8677-5c1d71514677 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:47.978916 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-0e8c0bf7-5fdf-4d31-8677-5c1d71514677 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 779c13cd-7a7a-47b4-b488-0d1e365c3dc4] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:47.984790 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0e8c0bf7-5fdf-4d31-8677-5c1d71514677 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:47.985227 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0e8c0bf7-5fdf-4d31-8677-5c1d71514677 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:47.985977 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0e8c0bf7-5fdf-4d31-8677-5c1d71514677 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:47.986406 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0e8c0bf7-5fdf-4d31-8677-5c1d71514677 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:48.161695 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-0e8c0bf7-5fdf-4d31-8677-5c1d71514677 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:48.169460 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [req-97e99470-18a3-44b3-bb85-8f1ae42a7ef2 req-603ea84e-f65f-4b96-a2ef-6a97a6b84a73 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6bcf99af-f089-4543-94c0-39ecee139bf7", "name": "network-vif-deleted", "tag": "b90b496d-8c4e-46bd-93a0-9e0e45bd14f0"}]} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:15:48.169703 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-0e8c0bf7-5fdf-4d31-8677-5c1d71514677 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4" status: 200 len: 1520 microversion: 2.1 time: 0.195290 Mar 31 18:15:48.170486 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 132/282] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:47 2022] GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4 => generated 1520 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:48.178398 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-97e99470-18a3-44b3-bb85-8f1ae42a7ef2 req-603ea84e-f65f-4b96-a2ef-6a97a6b84a73 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:48.178878 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-97e99470-18a3-44b3-bb85-8f1ae42a7ef2 req-603ea84e-f65f-4b96-a2ef-6a97a6b84a73 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:48.191019 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.compute.server_external_events [req-97e99470-18a3-44b3-bb85-8f1ae42a7ef2 req-603ea84e-f65f-4b96-a2ef-6a97a6b84a73 service nova] Creating event network-vif-deleted:b90b496d-8c4e-46bd-93a0-9e0e45bd14f0 for instance 6bcf99af-f089-4543-94c0-39ecee139bf7 on hv-cinder-maste Mar 31 18:15:48.196010 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [req-97e99470-18a3-44b3-bb85-8f1ae42a7ef2 req-603ea84e-f65f-4b96-a2ef-6a97a6b84a73 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030525 Mar 31 18:15:48.196693 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 151/283] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:15:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 31 18:15:48.388404 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-a72b691c-2b96-47a1-bb10-64df4bd1e9d6 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:48.388919 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-a72b691c-2b96-47a1-bb10-64df4bd1e9d6 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] [instance: 6bcf99af-f089-4543-94c0-39ecee139bf7] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:48.395103 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a72b691c-2b96-47a1-bb10-64df4bd1e9d6 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:48.395544 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a72b691c-2b96-47a1-bb10-64df4bd1e9d6 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:48.396326 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a72b691c-2b96-47a1-bb10-64df4bd1e9d6 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:48.396754 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a72b691c-2b96-47a1-bb10-64df4bd1e9d6 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:48.454942 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-a72b691c-2b96-47a1-bb10-64df4bd1e9d6 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be7ea3f86e04222ba3de78ec21b2b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b822e17d08cf49f79e8fd7faaa92a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:48.462481 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-a72b691c-2b96-47a1-bb10-64df4bd1e9d6 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] 10.222.0.58 "GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7" status: 200 len: 1427 microversion: 2.1 time: 0.078054 Mar 31 18:15:48.463074 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 133/284] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:48 2022] GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7 => generated 1427 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:48.782981 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-04b24265-6095-48cf-b5ac-2ea2bb1a12aa tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-868134798", "imageRef": "6241b999-6f6d-4076-88bc-345fa7386256", "flavorRef": "452", "networks": [{"uuid": "6985b94c-578f-440f-adb1-d40b9aefd2a5"}]}} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:15:48.859794 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.network.neutron [None req-04b24265-6095-48cf-b5ac-2ea2bb1a12aa tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] validate_networks() for [('6985b94c-578f-440f-adb1-d40b9aefd2a5', None, None, None, None, None)] {{(pid=117538) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 31 18:15:49.187595 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-de94059e-1811-43e8-a5c0-8c2bdc4ea570 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:49.188196 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-de94059e-1811-43e8-a5c0-8c2bdc4ea570 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 779c13cd-7a7a-47b4-b488-0d1e365c3dc4] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:49.195037 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-de94059e-1811-43e8-a5c0-8c2bdc4ea570 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:49.195475 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-de94059e-1811-43e8-a5c0-8c2bdc4ea570 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:49.196229 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-de94059e-1811-43e8-a5c0-8c2bdc4ea570 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:49.196657 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-de94059e-1811-43e8-a5c0-8c2bdc4ea570 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:49.332273 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-de94059e-1811-43e8-a5c0-8c2bdc4ea570 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:49.339640 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-de94059e-1811-43e8-a5c0-8c2bdc4ea570 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4" status: 200 len: 1520 microversion: 2.1 time: 0.155832 Mar 31 18:15:49.340215 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 134/285] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:49 2022] GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:15:49.369430 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.virt.hardware [None req-04b24265-6095-48cf-b5ac-2ea2bb1a12aa tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Flavor limits 0:0:0 {{(pid=117538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 31 18:15:49.369853 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.virt.hardware [None req-04b24265-6095-48cf-b5ac-2ea2bb1a12aa tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Image limits 0:0:0 {{(pid=117538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 31 18:15:49.370354 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.virt.hardware [None req-04b24265-6095-48cf-b5ac-2ea2bb1a12aa tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Flavor pref 0:0:0 {{(pid=117538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 31 18:15:49.370802 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.virt.hardware [None req-04b24265-6095-48cf-b5ac-2ea2bb1a12aa tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Image pref 0:0:0 {{(pid=117538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 31 18:15:49.371218 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.virt.hardware [None req-04b24265-6095-48cf-b5ac-2ea2bb1a12aa tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 31 18:15:49.380354 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-04b24265-6095-48cf-b5ac-2ea2bb1a12aa tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:49.380799 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-04b24265-6095-48cf-b5ac-2ea2bb1a12aa tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:49.381592 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-04b24265-6095-48cf-b5ac-2ea2bb1a12aa tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:49.382026 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-04b24265-6095-48cf-b5ac-2ea2bb1a12aa tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:49.404253 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.quota [None req-04b24265-6095-48cf-b5ac-2ea2bb1a12aa tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Getting quotas for project b2d7dee7188943ae84823848038e5357. Resources: {'instances', 'ram', 'cores'} {{(pid=117538) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 31 18:15:49.408679 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.quota [None req-04b24265-6095-48cf-b5ac-2ea2bb1a12aa tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Getting quotas for user 37dd6eaa597d4b61b3c7f3719217baa1 and project b2d7dee7188943ae84823848038e5357. Resources: {'instances', 'ram', 'cores'} {{(pid=117538) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 31 18:15:49.420189 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-04b24265-6095-48cf-b5ac-2ea2bb1a12aa tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Going to run 1 instances... {{(pid=117538) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 31 18:15:49.422890 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-04b24265-6095-48cf-b5ac-2ea2bb1a12aa tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 46c453cb-f20b-4389-9b6c-58852e5cd908] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6241b999-6f6d-4076-88bc-345fa7386256',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117538) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 31 18:15:49.480430 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-bc6ecb15-3315-4544-a26e-6236fa947d76 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:49.481065 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-bc6ecb15-3315-4544-a26e-6236fa947d76 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] [instance: 6bcf99af-f089-4543-94c0-39ecee139bf7] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:49.488506 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-bc6ecb15-3315-4544-a26e-6236fa947d76 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:49.488980 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-bc6ecb15-3315-4544-a26e-6236fa947d76 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:49.489784 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-bc6ecb15-3315-4544-a26e-6236fa947d76 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:49.490261 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-bc6ecb15-3315-4544-a26e-6236fa947d76 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:49.550540 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-bc6ecb15-3315-4544-a26e-6236fa947d76 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be7ea3f86e04222ba3de78ec21b2b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b822e17d08cf49f79e8fd7faaa92a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:49.558490 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-bc6ecb15-3315-4544-a26e-6236fa947d76 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] 10.222.0.58 "GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7" status: 200 len: 1427 microversion: 2.1 time: 0.081956 Mar 31 18:15:49.559106 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 135/286] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:49 2022] GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7 => generated 1427 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:15:49.608980 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-04b24265-6095-48cf-b5ac-2ea2bb1a12aa tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.830359 Mar 31 18:15:49.610196 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 152/287] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Mar 31 18:15:48 2022] POST /compute/v2.1/servers => generated 380 bytes in 833 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 31 18:15:49.620956 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-76fd6f96-5459-4e7f-8366-a36311e7edf1 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:49.621887 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-76fd6f96-5459-4e7f-8366-a36311e7edf1 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 46c453cb-f20b-4389-9b6c-58852e5cd908] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:49.696264 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-76fd6f96-5459-4e7f-8366-a36311e7edf1 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dd6eaa597d4b61b3c7f3719217baa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7dee7188943ae84823848038e5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:49.705566 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-76fd6f96-5459-4e7f-8366-a36311e7edf1 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] 10.222.0.58 "GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908" status: 200 len: 1213 microversion: 2.1 time: 0.088059 Mar 31 18:15:49.706219 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 136/288] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:49 2022] GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908 => generated 1213 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:50.358147 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-c8ffa820-899f-45c3-95fd-184d42caa663 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:50.358827 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-c8ffa820-899f-45c3-95fd-184d42caa663 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 779c13cd-7a7a-47b4-b488-0d1e365c3dc4] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:50.365940 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c8ffa820-899f-45c3-95fd-184d42caa663 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:50.366387 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c8ffa820-899f-45c3-95fd-184d42caa663 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:50.367186 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c8ffa820-899f-45c3-95fd-184d42caa663 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:50.367617 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c8ffa820-899f-45c3-95fd-184d42caa663 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:50.503417 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-c8ffa820-899f-45c3-95fd-184d42caa663 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:50.510675 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-c8ffa820-899f-45c3-95fd-184d42caa663 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4" status: 200 len: 1520 microversion: 2.1 time: 0.157125 Mar 31 18:15:50.511239 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 153/289] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:50 2022] GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:50.576620 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-e9a75633-8dcb-49d2-9a1f-3b3d4425c773 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:50.577796 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-e9a75633-8dcb-49d2-9a1f-3b3d4425c773 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] [instance: 6bcf99af-f089-4543-94c0-39ecee139bf7] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:50.584530 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e9a75633-8dcb-49d2-9a1f-3b3d4425c773 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:50.584994 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e9a75633-8dcb-49d2-9a1f-3b3d4425c773 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:50.585775 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e9a75633-8dcb-49d2-9a1f-3b3d4425c773 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:50.586918 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e9a75633-8dcb-49d2-9a1f-3b3d4425c773 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:50.651738 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-e9a75633-8dcb-49d2-9a1f-3b3d4425c773 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be7ea3f86e04222ba3de78ec21b2b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b822e17d08cf49f79e8fd7faaa92a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:50.660360 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-e9a75633-8dcb-49d2-9a1f-3b3d4425c773 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] 10.222.0.58 "GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7" status: 200 len: 1427 microversion: 2.1 time: 0.087745 Mar 31 18:15:50.661184 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 137/290] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:50 2022] GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7 => generated 1427 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:50.723196 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-b32fc412-fe14-48a3-8959-dd2d7fa58a93 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:50.723687 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-b32fc412-fe14-48a3-8959-dd2d7fa58a93 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 46c453cb-f20b-4389-9b6c-58852e5cd908] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:50.774545 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-b32fc412-fe14-48a3-8959-dd2d7fa58a93 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dd6eaa597d4b61b3c7f3719217baa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7dee7188943ae84823848038e5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:50.781819 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-b32fc412-fe14-48a3-8959-dd2d7fa58a93 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] 10.222.0.58 "GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908" status: 200 len: 1213 microversion: 2.1 time: 0.062994 Mar 31 18:15:50.782407 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 154/291] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:50 2022] GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908 => generated 1213 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:51.528671 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-1ab508f9-5b27-4a00-a95b-436d18a4eae3 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:51.529270 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-1ab508f9-5b27-4a00-a95b-436d18a4eae3 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 779c13cd-7a7a-47b4-b488-0d1e365c3dc4] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:51.535212 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1ab508f9-5b27-4a00-a95b-436d18a4eae3 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:51.535644 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1ab508f9-5b27-4a00-a95b-436d18a4eae3 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:51.536383 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1ab508f9-5b27-4a00-a95b-436d18a4eae3 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:51.536806 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1ab508f9-5b27-4a00-a95b-436d18a4eae3 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:51.666996 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-1ab508f9-5b27-4a00-a95b-436d18a4eae3 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:51.674452 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-1ab508f9-5b27-4a00-a95b-436d18a4eae3 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4" status: 200 len: 1520 microversion: 2.1 time: 0.149867 Mar 31 18:15:51.675038 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 138/292] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:51 2022] GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:51.677743 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-726173f3-8600-4c7b-9610-5fb4923f3093 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:51.678369 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-726173f3-8600-4c7b-9610-5fb4923f3093 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] [instance: 6bcf99af-f089-4543-94c0-39ecee139bf7] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:51.685170 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-726173f3-8600-4c7b-9610-5fb4923f3093 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:51.685636 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-726173f3-8600-4c7b-9610-5fb4923f3093 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:51.686471 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-726173f3-8600-4c7b-9610-5fb4923f3093 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:51.686919 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-726173f3-8600-4c7b-9610-5fb4923f3093 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:51.746626 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-726173f3-8600-4c7b-9610-5fb4923f3093 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be7ea3f86e04222ba3de78ec21b2b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b822e17d08cf49f79e8fd7faaa92a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:51.754506 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-726173f3-8600-4c7b-9610-5fb4923f3093 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] 10.222.0.58 "GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7" status: 200 len: 1427 microversion: 2.1 time: 0.081132 Mar 31 18:15:51.755081 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 155/293] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:51 2022] GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7 => generated 1427 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:15:51.797989 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-25f7751a-0770-48cb-ac00-73312de5c71d tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:51.799313 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-25f7751a-0770-48cb-ac00-73312de5c71d tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 46c453cb-f20b-4389-9b6c-58852e5cd908] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:51.804993 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-25f7751a-0770-48cb-ac00-73312de5c71d tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:51.805433 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-25f7751a-0770-48cb-ac00-73312de5c71d tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:51.806180 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-25f7751a-0770-48cb-ac00-73312de5c71d tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:51.806602 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-25f7751a-0770-48cb-ac00-73312de5c71d tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:51.863556 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-25f7751a-0770-48cb-ac00-73312de5c71d tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dd6eaa597d4b61b3c7f3719217baa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7dee7188943ae84823848038e5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:51.872191 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-25f7751a-0770-48cb-ac00-73312de5c71d tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] 10.222.0.58 "GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908" status: 200 len: 1217 microversion: 2.1 time: 0.077297 Mar 31 18:15:51.872951 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 139/294] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:51 2022] GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908 => generated 1217 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:52.691521 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-8334f802-8aeb-4a39-88cc-6de2cb735992 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:52.692055 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-8334f802-8aeb-4a39-88cc-6de2cb735992 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 779c13cd-7a7a-47b4-b488-0d1e365c3dc4] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:52.698333 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8334f802-8aeb-4a39-88cc-6de2cb735992 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:52.698822 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8334f802-8aeb-4a39-88cc-6de2cb735992 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:52.699581 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8334f802-8aeb-4a39-88cc-6de2cb735992 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:52.700010 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8334f802-8aeb-4a39-88cc-6de2cb735992 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:52.772149 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-1966bea7-a8ad-46ae-a94f-5417b2d79418 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:52.772747 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-1966bea7-a8ad-46ae-a94f-5417b2d79418 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] [instance: 6bcf99af-f089-4543-94c0-39ecee139bf7] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:52.779419 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1966bea7-a8ad-46ae-a94f-5417b2d79418 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:52.779946 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1966bea7-a8ad-46ae-a94f-5417b2d79418 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:52.780794 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1966bea7-a8ad-46ae-a94f-5417b2d79418 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:52.781487 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1966bea7-a8ad-46ae-a94f-5417b2d79418 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:52.816572 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1966bea7-a8ad-46ae-a94f-5417b2d79418 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:52.817015 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1966bea7-a8ad-46ae-a94f-5417b2d79418 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:52.817593 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.objects.instance [None req-1966bea7-a8ad-46ae-a94f-5417b2d79418 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lazy-loading 'fault' on Instance uuid 6bcf99af-f089-4543-94c0-39ecee139bf7 {{(pid=117539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 31 18:15:52.851382 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-8334f802-8aeb-4a39-88cc-6de2cb735992 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:52.861381 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-8334f802-8aeb-4a39-88cc-6de2cb735992 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4" status: 200 len: 1520 microversion: 2.1 time: 0.173955 Mar 31 18:15:52.863222 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 156/295] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:52 2022] GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4 => generated 1520 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:52.867647 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-1966bea7-a8ad-46ae-a94f-5417b2d79418 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0be7ea3f86e04222ba3de78ec21b2b0b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b822e17d08cf49f79e8fd7faaa92a0a3', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:52.874999 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-1966bea7-a8ad-46ae-a94f-5417b2d79418 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] 10.222.0.58 "GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7" status: 200 len: 1304 microversion: 2.1 time: 0.106665 Mar 31 18:15:52.875543 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 140/296] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:52 2022] GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7 => generated 1304 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:52.889580 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-9746a616-a131-4276-b49a-3bf978c9e8ca tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:52.890502 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-9746a616-a131-4276-b49a-3bf978c9e8ca tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 46c453cb-f20b-4389-9b6c-58852e5cd908] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:52.896948 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9746a616-a131-4276-b49a-3bf978c9e8ca tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:52.897405 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9746a616-a131-4276-b49a-3bf978c9e8ca tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:52.898162 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9746a616-a131-4276-b49a-3bf978c9e8ca tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:52.898583 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9746a616-a131-4276-b49a-3bf978c9e8ca tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:52.961672 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-9746a616-a131-4276-b49a-3bf978c9e8ca tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dd6eaa597d4b61b3c7f3719217baa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7dee7188943ae84823848038e5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:52.968831 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-9746a616-a131-4276-b49a-3bf978c9e8ca tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] 10.222.0.58 "GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908" status: 200 len: 1265 microversion: 2.1 time: 0.083046 Mar 31 18:15:52.969415 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 157/297] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:52 2022] GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908 => generated 1265 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:53.880806 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-075b51af-92a9-48ef-8735-d7815f65bdb5 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:53.881978 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-075b51af-92a9-48ef-8735-d7815f65bdb5 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 779c13cd-7a7a-47b4-b488-0d1e365c3dc4] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:53.892930 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-1cae4201-e371-485b-8a7b-e4be218dcc41 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:53.893567 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-1cae4201-e371-485b-8a7b-e4be218dcc41 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] [instance: 6bcf99af-f089-4543-94c0-39ecee139bf7] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:53.898584 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-075b51af-92a9-48ef-8735-d7815f65bdb5 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:53.899050 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-075b51af-92a9-48ef-8735-d7815f65bdb5 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:53.899825 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-075b51af-92a9-48ef-8735-d7815f65bdb5 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:53.900250 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-075b51af-92a9-48ef-8735-d7815f65bdb5 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:53.901047 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-1cae4201-e371-485b-8a7b-e4be218dcc41 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:53.901572 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-1cae4201-e371-485b-8a7b-e4be218dcc41 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:53.902744 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-1cae4201-e371-485b-8a7b-e4be218dcc41 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:53.903245 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-1cae4201-e371-485b-8a7b-e4be218dcc41 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:53.920909 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.wsgi [None req-1cae4201-e371-485b-8a7b-e4be218dcc41 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] HTTP exception thrown: Instance 6bcf99af-f089-4543-94c0-39ecee139bf7 could not be found. Mar 31 18:15:53.921522 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-1cae4201-e371-485b-8a7b-e4be218dcc41 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] Returning 404 to user: Instance 6bcf99af-f089-4543-94c0-39ecee139bf7 could not be found. {{(pid=117538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:15:53.922344 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-1cae4201-e371-485b-8a7b-e4be218dcc41 tempest-VolumesNegativeTest-790833909 tempest-VolumesNegativeTest-790833909-project] 10.222.0.58 "GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7" status: 404 len: 111 microversion: 2.1 time: 0.034063 Mar 31 18:15:53.923312 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 158/298] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:53 2022] GET /compute/v2.1/servers/6bcf99af-f089-4543-94c0-39ecee139bf7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 31 18:15:53.985351 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-9fefdda6-a557-4988-9c1a-8e5018a63a1f tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:53.987362 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-9fefdda6-a557-4988-9c1a-8e5018a63a1f tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 46c453cb-f20b-4389-9b6c-58852e5cd908] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:53.993395 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9fefdda6-a557-4988-9c1a-8e5018a63a1f tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:53.993993 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9fefdda6-a557-4988-9c1a-8e5018a63a1f tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:53.994891 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9fefdda6-a557-4988-9c1a-8e5018a63a1f tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:53.995430 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9fefdda6-a557-4988-9c1a-8e5018a63a1f tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:54.058056 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-9fefdda6-a557-4988-9c1a-8e5018a63a1f tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dd6eaa597d4b61b3c7f3719217baa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7dee7188943ae84823848038e5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:54.066923 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-9fefdda6-a557-4988-9c1a-8e5018a63a1f tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] 10.222.0.58 "GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908" status: 200 len: 1273 microversion: 2.1 time: 0.085562 Mar 31 18:15:54.067486 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 159/299] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:53 2022] GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908 => generated 1273 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:15:54.181558 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-075b51af-92a9-48ef-8735-d7815f65bdb5 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:54.190585 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-075b51af-92a9-48ef-8735-d7815f65bdb5 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4" status: 200 len: 1520 microversion: 2.1 time: 0.315036 Mar 31 18:15:54.199117 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 141/300] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:53 2022] GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4 => generated 1520 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:55.084519 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-438fd3f8-69ca-48f2-8a21-dbe0048621ed tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:55.085213 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-438fd3f8-69ca-48f2-8a21-dbe0048621ed tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 46c453cb-f20b-4389-9b6c-58852e5cd908] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:55.091438 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-438fd3f8-69ca-48f2-8a21-dbe0048621ed tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:55.091881 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-438fd3f8-69ca-48f2-8a21-dbe0048621ed tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:55.092838 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-438fd3f8-69ca-48f2-8a21-dbe0048621ed tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:55.093268 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-438fd3f8-69ca-48f2-8a21-dbe0048621ed tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:55.166070 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-438fd3f8-69ca-48f2-8a21-dbe0048621ed tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dd6eaa597d4b61b3c7f3719217baa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7dee7188943ae84823848038e5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:55.175335 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-438fd3f8-69ca-48f2-8a21-dbe0048621ed tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] 10.222.0.58 "GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908" status: 200 len: 1273 microversion: 2.1 time: 0.094665 Mar 31 18:15:55.176111 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 160/301] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:55 2022] GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908 => generated 1273 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:55.208280 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-18bdfb99-8dd3-464a-9bb8-afa6170ac994 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:55.208975 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-18bdfb99-8dd3-464a-9bb8-afa6170ac994 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 779c13cd-7a7a-47b4-b488-0d1e365c3dc4] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:55.215098 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-18bdfb99-8dd3-464a-9bb8-afa6170ac994 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:55.215540 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-18bdfb99-8dd3-464a-9bb8-afa6170ac994 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:55.216558 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-18bdfb99-8dd3-464a-9bb8-afa6170ac994 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:55.217141 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-18bdfb99-8dd3-464a-9bb8-afa6170ac994 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:55.459455 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-18bdfb99-8dd3-464a-9bb8-afa6170ac994 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:55.466810 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-18bdfb99-8dd3-464a-9bb8-afa6170ac994 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4" status: 200 len: 1520 microversion: 2.1 time: 0.262685 Mar 31 18:15:55.467601 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 142/302] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:55 2022] GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4 => generated 1520 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:56.194184 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-4ae60e7c-95eb-45b0-a735-c20dad6dd212 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:56.194845 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-4ae60e7c-95eb-45b0-a735-c20dad6dd212 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 46c453cb-f20b-4389-9b6c-58852e5cd908] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:56.202600 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4ae60e7c-95eb-45b0-a735-c20dad6dd212 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:56.204859 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4ae60e7c-95eb-45b0-a735-c20dad6dd212 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:56.204859 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4ae60e7c-95eb-45b0-a735-c20dad6dd212 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:56.204859 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4ae60e7c-95eb-45b0-a735-c20dad6dd212 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:56.275596 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-4ae60e7c-95eb-45b0-a735-c20dad6dd212 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dd6eaa597d4b61b3c7f3719217baa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7dee7188943ae84823848038e5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:56.285300 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-4ae60e7c-95eb-45b0-a735-c20dad6dd212 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] 10.222.0.58 "GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908" status: 200 len: 1273 microversion: 2.1 time: 0.095132 Mar 31 18:15:56.286131 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 161/303] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:56 2022] GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908 => generated 1273 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:15:56.489052 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-1ef6554a-f50d-4470-a87e-c0b89809026f tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:56.490395 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-1ef6554a-f50d-4470-a87e-c0b89809026f tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 779c13cd-7a7a-47b4-b488-0d1e365c3dc4] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:56.497681 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1ef6554a-f50d-4470-a87e-c0b89809026f tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:56.498195 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1ef6554a-f50d-4470-a87e-c0b89809026f tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:56.499170 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1ef6554a-f50d-4470-a87e-c0b89809026f tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:56.499598 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1ef6554a-f50d-4470-a87e-c0b89809026f tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:56.649417 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-1ef6554a-f50d-4470-a87e-c0b89809026f tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:56.657350 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-1ef6554a-f50d-4470-a87e-c0b89809026f tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4" status: 200 len: 1520 microversion: 2.1 time: 0.174305 Mar 31 18:15:56.657924 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 143/304] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:56 2022] GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4 => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:57.303486 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-44b77282-66c0-49dc-ac57-85bd6c43764d tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:57.304101 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-44b77282-66c0-49dc-ac57-85bd6c43764d tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 46c453cb-f20b-4389-9b6c-58852e5cd908] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:57.310718 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-44b77282-66c0-49dc-ac57-85bd6c43764d tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:57.311283 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-44b77282-66c0-49dc-ac57-85bd6c43764d tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:57.312057 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-44b77282-66c0-49dc-ac57-85bd6c43764d tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:57.312492 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-44b77282-66c0-49dc-ac57-85bd6c43764d tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:57.374057 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-44b77282-66c0-49dc-ac57-85bd6c43764d tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dd6eaa597d4b61b3c7f3719217baa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7dee7188943ae84823848038e5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:57.381871 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-44b77282-66c0-49dc-ac57-85bd6c43764d tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] 10.222.0.58 "GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908" status: 200 len: 1273 microversion: 2.1 time: 0.082867 Mar 31 18:15:57.382638 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 162/305] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:57 2022] GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908 => generated 1273 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:57.674709 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-aebfd8d6-1a51-4763-9408-a0b6c716b7ad tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:57.675471 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-aebfd8d6-1a51-4763-9408-a0b6c716b7ad tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 779c13cd-7a7a-47b4-b488-0d1e365c3dc4] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:57.681262 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-aebfd8d6-1a51-4763-9408-a0b6c716b7ad tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:57.681701 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-aebfd8d6-1a51-4763-9408-a0b6c716b7ad tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:57.682450 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-aebfd8d6-1a51-4763-9408-a0b6c716b7ad tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:57.682902 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-aebfd8d6-1a51-4763-9408-a0b6c716b7ad tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:57.819633 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-aebfd8d6-1a51-4763-9408-a0b6c716b7ad tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:57.826919 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-aebfd8d6-1a51-4763-9408-a0b6c716b7ad tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4" status: 200 len: 1520 microversion: 2.1 time: 0.156390 Mar 31 18:15:57.827485 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 144/306] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:57 2022] GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:58.402104 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-769339bc-838a-4217-9b0d-1792de2808dc tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:58.405699 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-769339bc-838a-4217-9b0d-1792de2808dc tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 46c453cb-f20b-4389-9b6c-58852e5cd908] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:58.432825 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-769339bc-838a-4217-9b0d-1792de2808dc tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:58.433794 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-769339bc-838a-4217-9b0d-1792de2808dc tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:58.435826 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-769339bc-838a-4217-9b0d-1792de2808dc tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:58.436730 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-769339bc-838a-4217-9b0d-1792de2808dc tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:58.563529 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-769339bc-838a-4217-9b0d-1792de2808dc tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dd6eaa597d4b61b3c7f3719217baa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7dee7188943ae84823848038e5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:58.570748 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-769339bc-838a-4217-9b0d-1792de2808dc tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] 10.222.0.58 "GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908" status: 200 len: 1271 microversion: 2.1 time: 0.174761 Mar 31 18:15:58.581894 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 163/307] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:58 2022] GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908 => generated 1271 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:58.845286 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-cc878a5b-0f57-4a5f-92d7-f946cfe46e61 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:58.845993 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-cc878a5b-0f57-4a5f-92d7-f946cfe46e61 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 779c13cd-7a7a-47b4-b488-0d1e365c3dc4] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:58.852023 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-cc878a5b-0f57-4a5f-92d7-f946cfe46e61 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:58.852345 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-cc878a5b-0f57-4a5f-92d7-f946cfe46e61 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:58.853108 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-cc878a5b-0f57-4a5f-92d7-f946cfe46e61 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:58.853579 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-cc878a5b-0f57-4a5f-92d7-f946cfe46e61 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:59.018718 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-cc878a5b-0f57-4a5f-92d7-f946cfe46e61 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:59.028268 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-cc878a5b-0f57-4a5f-92d7-f946cfe46e61 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4" status: 200 len: 1520 microversion: 2.1 time: 0.187229 Mar 31 18:15:59.029258 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 145/308] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:58 2022] GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4 => generated 1520 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:59.589293 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-f8d7ccb0-826e-4fb9-a909-2b89c781cdd5 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:15:59.589917 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-f8d7ccb0-826e-4fb9-a909-2b89c781cdd5 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 46c453cb-f20b-4389-9b6c-58852e5cd908] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:15:59.596895 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f8d7ccb0-826e-4fb9-a909-2b89c781cdd5 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:59.597340 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f8d7ccb0-826e-4fb9-a909-2b89c781cdd5 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:59.598096 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f8d7ccb0-826e-4fb9-a909-2b89c781cdd5 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:59.600600 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f8d7ccb0-826e-4fb9-a909-2b89c781cdd5 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:59.811977 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-f8d7ccb0-826e-4fb9-a909-2b89c781cdd5 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dd6eaa597d4b61b3c7f3719217baa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7dee7188943ae84823848038e5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:15:59.820767 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-f8d7ccb0-826e-4fb9-a909-2b89c781cdd5 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] 10.222.0.58 "GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908" status: 200 len: 1313 microversion: 2.1 time: 0.235386 Mar 31 18:15:59.821329 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 164/309] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:15:59 2022] GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908 => generated 1313 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:15:59.894942 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [req-34fe229a-6aa6-4d1e-9826-fcf75e6bcd29 req-51b87eeb-8ea7-40f4-96fa-36168db0c9ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "46c453cb-f20b-4389-9b6c-58852e5cd908", "tag": "061db997-2b27-4a9a-9154-2a254b2384aa"}]} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:15:59.904135 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-34fe229a-6aa6-4d1e-9826-fcf75e6bcd29 req-51b87eeb-8ea7-40f4-96fa-36168db0c9ea service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:15:59.904619 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-34fe229a-6aa6-4d1e-9826-fcf75e6bcd29 req-51b87eeb-8ea7-40f4-96fa-36168db0c9ea service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:15:59.916622 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.compute.server_external_events [req-34fe229a-6aa6-4d1e-9826-fcf75e6bcd29 req-51b87eeb-8ea7-40f4-96fa-36168db0c9ea service nova] Creating event network-changed:061db997-2b27-4a9a-9154-2a254b2384aa for instance 46c453cb-f20b-4389-9b6c-58852e5cd908 on hv-cinder-maste Mar 31 18:15:59.923761 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [req-34fe229a-6aa6-4d1e-9826-fcf75e6bcd29 req-51b87eeb-8ea7-40f4-96fa-36168db0c9ea service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032937 Mar 31 18:15:59.924607 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 146/310] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:15:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 31 18:16:00.045373 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-4eac7708-185b-4e68-b9be-60352a381b46 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:00.045782 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-4eac7708-185b-4e68-b9be-60352a381b46 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 779c13cd-7a7a-47b4-b488-0d1e365c3dc4] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:00.052952 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4eac7708-185b-4e68-b9be-60352a381b46 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:00.053401 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4eac7708-185b-4e68-b9be-60352a381b46 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:00.054317 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4eac7708-185b-4e68-b9be-60352a381b46 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:00.054762 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4eac7708-185b-4e68-b9be-60352a381b46 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:00.308406 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-4eac7708-185b-4e68-b9be-60352a381b46 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:00.315953 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-4eac7708-185b-4e68-b9be-60352a381b46 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4" status: 200 len: 1520 microversion: 2.1 time: 0.274592 Mar 31 18:16:00.316515 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 165/311] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:00 2022] GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4 => generated 1520 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:00.838412 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-885ab245-d834-4682-9de2-717d016dcc90 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:00.839162 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-885ab245-d834-4682-9de2-717d016dcc90 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 46c453cb-f20b-4389-9b6c-58852e5cd908] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:00.846199 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-885ab245-d834-4682-9de2-717d016dcc90 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:00.846657 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-885ab245-d834-4682-9de2-717d016dcc90 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:00.847414 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-885ab245-d834-4682-9de2-717d016dcc90 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:00.847850 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-885ab245-d834-4682-9de2-717d016dcc90 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:00.980950 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-885ab245-d834-4682-9de2-717d016dcc90 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dd6eaa597d4b61b3c7f3719217baa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7dee7188943ae84823848038e5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:00.989100 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-885ab245-d834-4682-9de2-717d016dcc90 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] 10.222.0.58 "GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908" status: 200 len: 1313 microversion: 2.1 time: 0.155169 Mar 31 18:16:00.989862 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 147/312] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:00 2022] GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:01.333527 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-ae0085ae-f2a7-4021-93ab-f411542663a0 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:01.334060 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-ae0085ae-f2a7-4021-93ab-f411542663a0 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 779c13cd-7a7a-47b4-b488-0d1e365c3dc4] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:01.340428 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-ae0085ae-f2a7-4021-93ab-f411542663a0 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:01.340867 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-ae0085ae-f2a7-4021-93ab-f411542663a0 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:01.341626 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-ae0085ae-f2a7-4021-93ab-f411542663a0 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:01.342048 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-ae0085ae-f2a7-4021-93ab-f411542663a0 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:01.489933 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-ae0085ae-f2a7-4021-93ab-f411542663a0 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:01.497267 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-ae0085ae-f2a7-4021-93ab-f411542663a0 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4" status: 200 len: 1520 microversion: 2.1 time: 0.167699 Mar 31 18:16:01.497835 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 166/313] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:01 2022] GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:02.006425 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-1ce5efa8-0c46-4544-8253-f511368d32c5 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:02.007217 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-1ce5efa8-0c46-4544-8253-f511368d32c5 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 46c453cb-f20b-4389-9b6c-58852e5cd908] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:02.013090 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1ce5efa8-0c46-4544-8253-f511368d32c5 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:02.013532 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1ce5efa8-0c46-4544-8253-f511368d32c5 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:02.015013 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1ce5efa8-0c46-4544-8253-f511368d32c5 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:02.015439 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1ce5efa8-0c46-4544-8253-f511368d32c5 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:02.161370 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-1ce5efa8-0c46-4544-8253-f511368d32c5 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dd6eaa597d4b61b3c7f3719217baa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7dee7188943ae84823848038e5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:02.168847 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-1ce5efa8-0c46-4544-8253-f511368d32c5 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] 10.222.0.58 "GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908" status: 200 len: 1313 microversion: 2.1 time: 0.166239 Mar 31 18:16:02.169412 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 148/314] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:02 2022] GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908 => generated 1313 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:16:02.512982 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-3a262ff2-1e75-4a63-b110-5a12a00e9ed3 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:02.513612 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-3a262ff2-1e75-4a63-b110-5a12a00e9ed3 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 779c13cd-7a7a-47b4-b488-0d1e365c3dc4] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:02.520277 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3a262ff2-1e75-4a63-b110-5a12a00e9ed3 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:02.520739 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3a262ff2-1e75-4a63-b110-5a12a00e9ed3 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:02.524060 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3a262ff2-1e75-4a63-b110-5a12a00e9ed3 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:02.524060 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3a262ff2-1e75-4a63-b110-5a12a00e9ed3 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:02.658786 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-3a262ff2-1e75-4a63-b110-5a12a00e9ed3 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:02.666053 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-3a262ff2-1e75-4a63-b110-5a12a00e9ed3 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4" status: 200 len: 1520 microversion: 2.1 time: 0.156885 Mar 31 18:16:02.666627 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 167/315] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:02 2022] GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4 => generated 1520 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:03.186092 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-fa379b3b-4c69-4d9b-8d98-b927864169ff tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:03.186818 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-fa379b3b-4c69-4d9b-8d98-b927864169ff tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 46c453cb-f20b-4389-9b6c-58852e5cd908] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:03.192911 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-fa379b3b-4c69-4d9b-8d98-b927864169ff tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:03.193353 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-fa379b3b-4c69-4d9b-8d98-b927864169ff tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:03.194113 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-fa379b3b-4c69-4d9b-8d98-b927864169ff tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:03.194543 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-fa379b3b-4c69-4d9b-8d98-b927864169ff tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:03.330571 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-fa379b3b-4c69-4d9b-8d98-b927864169ff tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dd6eaa597d4b61b3c7f3719217baa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7dee7188943ae84823848038e5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:03.337617 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-fa379b3b-4c69-4d9b-8d98-b927864169ff tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] 10.222.0.58 "GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908" status: 200 len: 1313 microversion: 2.1 time: 0.155535 Mar 31 18:16:03.338174 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 149/316] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:03 2022] GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:03.683772 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-02b0310b-46bf-40d5-95e2-458d71ec77c1 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:03.684638 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-02b0310b-46bf-40d5-95e2-458d71ec77c1 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 779c13cd-7a7a-47b4-b488-0d1e365c3dc4] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:03.698686 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-02b0310b-46bf-40d5-95e2-458d71ec77c1 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:03.698686 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-02b0310b-46bf-40d5-95e2-458d71ec77c1 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:03.698686 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-02b0310b-46bf-40d5-95e2-458d71ec77c1 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:03.698686 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-02b0310b-46bf-40d5-95e2-458d71ec77c1 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:03.829790 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-02b0310b-46bf-40d5-95e2-458d71ec77c1 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:03.837416 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-02b0310b-46bf-40d5-95e2-458d71ec77c1 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4" status: 200 len: 1520 microversion: 2.1 time: 0.157434 Mar 31 18:16:03.837977 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 168/317] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:03 2022] GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:04.355222 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-2a341c4b-ea4a-4af1-b602-f5e7af9bd0a8 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:04.355781 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-2a341c4b-ea4a-4af1-b602-f5e7af9bd0a8 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 46c453cb-f20b-4389-9b6c-58852e5cd908] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:04.361700 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-2a341c4b-ea4a-4af1-b602-f5e7af9bd0a8 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:04.362130 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-2a341c4b-ea4a-4af1-b602-f5e7af9bd0a8 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:04.362900 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-2a341c4b-ea4a-4af1-b602-f5e7af9bd0a8 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:04.363320 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-2a341c4b-ea4a-4af1-b602-f5e7af9bd0a8 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:04.496299 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-2a341c4b-ea4a-4af1-b602-f5e7af9bd0a8 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dd6eaa597d4b61b3c7f3719217baa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7dee7188943ae84823848038e5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:04.504471 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-2a341c4b-ea4a-4af1-b602-f5e7af9bd0a8 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] 10.222.0.58 "GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908" status: 200 len: 1313 microversion: 2.1 time: 0.153142 Mar 31 18:16:04.505046 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 150/318] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:04 2022] GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908 => generated 1313 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:04.854520 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-db565977-b439-498f-8d84-ec5082536146 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:04.855173 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-db565977-b439-498f-8d84-ec5082536146 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 779c13cd-7a7a-47b4-b488-0d1e365c3dc4] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:04.862666 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-db565977-b439-498f-8d84-ec5082536146 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:04.863077 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-db565977-b439-498f-8d84-ec5082536146 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:04.863841 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-db565977-b439-498f-8d84-ec5082536146 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:04.864276 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-db565977-b439-498f-8d84-ec5082536146 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:04.997114 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-db565977-b439-498f-8d84-ec5082536146 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:05.005440 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-db565977-b439-498f-8d84-ec5082536146 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4" status: 200 len: 1520 microversion: 2.1 time: 0.154743 Mar 31 18:16:05.006007 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 169/319] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:04 2022] GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:05.522018 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-192b58ef-9a8c-43c7-bd91-01a89905ed31 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:05.522685 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-192b58ef-9a8c-43c7-bd91-01a89905ed31 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 46c453cb-f20b-4389-9b6c-58852e5cd908] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:05.529070 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-192b58ef-9a8c-43c7-bd91-01a89905ed31 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:05.529516 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-192b58ef-9a8c-43c7-bd91-01a89905ed31 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:05.530362 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-192b58ef-9a8c-43c7-bd91-01a89905ed31 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:05.531443 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-192b58ef-9a8c-43c7-bd91-01a89905ed31 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:05.666046 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-192b58ef-9a8c-43c7-bd91-01a89905ed31 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dd6eaa597d4b61b3c7f3719217baa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7dee7188943ae84823848038e5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:05.673748 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-192b58ef-9a8c-43c7-bd91-01a89905ed31 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] 10.222.0.58 "GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908" status: 200 len: 1313 microversion: 2.1 time: 0.155482 Mar 31 18:16:05.674466 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 151/320] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:05 2022] GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908 => generated 1313 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:06.022521 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-b9fbc9ef-2739-47c2-b468-1a9a57856699 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:06.023163 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-b9fbc9ef-2739-47c2-b468-1a9a57856699 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 779c13cd-7a7a-47b4-b488-0d1e365c3dc4] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:06.029860 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b9fbc9ef-2739-47c2-b468-1a9a57856699 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:06.030246 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b9fbc9ef-2739-47c2-b468-1a9a57856699 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:06.031097 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b9fbc9ef-2739-47c2-b468-1a9a57856699 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:06.031667 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b9fbc9ef-2739-47c2-b468-1a9a57856699 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:06.165675 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-b9fbc9ef-2739-47c2-b468-1a9a57856699 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:06.173375 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-b9fbc9ef-2739-47c2-b468-1a9a57856699 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4" status: 200 len: 1520 microversion: 2.1 time: 0.154677 Mar 31 18:16:06.173923 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 170/321] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:06 2022] GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:06.690922 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-a7d7b905-af0f-4fa7-9ba8-8f4002a5d542 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:06.691526 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-a7d7b905-af0f-4fa7-9ba8-8f4002a5d542 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 46c453cb-f20b-4389-9b6c-58852e5cd908] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:06.697187 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a7d7b905-af0f-4fa7-9ba8-8f4002a5d542 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:06.697620 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a7d7b905-af0f-4fa7-9ba8-8f4002a5d542 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:06.698365 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a7d7b905-af0f-4fa7-9ba8-8f4002a5d542 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:06.698824 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a7d7b905-af0f-4fa7-9ba8-8f4002a5d542 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:06.840853 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-a7d7b905-af0f-4fa7-9ba8-8f4002a5d542 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dd6eaa597d4b61b3c7f3719217baa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7dee7188943ae84823848038e5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:06.848661 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-a7d7b905-af0f-4fa7-9ba8-8f4002a5d542 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] 10.222.0.58 "GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908" status: 200 len: 1313 microversion: 2.1 time: 0.162263 Mar 31 18:16:06.849229 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 152/322] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:06 2022] GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:07.222203 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-205092ae-10f8-4406-b522-2add67c7c829 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:07.224508 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-205092ae-10f8-4406-b522-2add67c7c829 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 779c13cd-7a7a-47b4-b488-0d1e365c3dc4] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:07.229079 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-205092ae-10f8-4406-b522-2add67c7c829 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:07.229523 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-205092ae-10f8-4406-b522-2add67c7c829 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:07.230277 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-205092ae-10f8-4406-b522-2add67c7c829 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:07.230733 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-205092ae-10f8-4406-b522-2add67c7c829 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:07.362579 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-205092ae-10f8-4406-b522-2add67c7c829 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:07.369862 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-205092ae-10f8-4406-b522-2add67c7c829 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4" status: 200 len: 1520 microversion: 2.1 time: 0.152464 Mar 31 18:16:07.370432 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 171/323] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:07 2022] GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4 => generated 1520 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:07.865252 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-26b46c63-9461-4eeb-bb61-514b5fe41328 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:07.865850 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-26b46c63-9461-4eeb-bb61-514b5fe41328 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 46c453cb-f20b-4389-9b6c-58852e5cd908] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:07.871684 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-26b46c63-9461-4eeb-bb61-514b5fe41328 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:07.872117 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-26b46c63-9461-4eeb-bb61-514b5fe41328 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:07.872862 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-26b46c63-9461-4eeb-bb61-514b5fe41328 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:07.873278 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-26b46c63-9461-4eeb-bb61-514b5fe41328 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:08.004714 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-26b46c63-9461-4eeb-bb61-514b5fe41328 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dd6eaa597d4b61b3c7f3719217baa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7dee7188943ae84823848038e5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:08.012141 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-26b46c63-9461-4eeb-bb61-514b5fe41328 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] 10.222.0.58 "GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908" status: 200 len: 1313 microversion: 2.1 time: 0.150611 Mar 31 18:16:08.012705 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 153/324] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:07 2022] GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:08.387332 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-a86b9669-cf2f-4647-990e-cdc83705afc1 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:08.387966 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-a86b9669-cf2f-4647-990e-cdc83705afc1 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 779c13cd-7a7a-47b4-b488-0d1e365c3dc4] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:08.394768 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a86b9669-cf2f-4647-990e-cdc83705afc1 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:08.395209 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a86b9669-cf2f-4647-990e-cdc83705afc1 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:08.395956 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a86b9669-cf2f-4647-990e-cdc83705afc1 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:08.396381 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a86b9669-cf2f-4647-990e-cdc83705afc1 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:08.525966 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-a86b9669-cf2f-4647-990e-cdc83705afc1 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:08.534019 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-a86b9669-cf2f-4647-990e-cdc83705afc1 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4" status: 200 len: 1520 microversion: 2.1 time: 0.150558 Mar 31 18:16:08.534518 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 172/325] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:08 2022] GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:09.029362 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-961929c6-98cc-4f99-b7f2-9e5e51171e06 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:09.029972 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-961929c6-98cc-4f99-b7f2-9e5e51171e06 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 46c453cb-f20b-4389-9b6c-58852e5cd908] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:09.036410 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-961929c6-98cc-4f99-b7f2-9e5e51171e06 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:09.036784 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-961929c6-98cc-4f99-b7f2-9e5e51171e06 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:09.037640 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-961929c6-98cc-4f99-b7f2-9e5e51171e06 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:09.037953 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-961929c6-98cc-4f99-b7f2-9e5e51171e06 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:09.188661 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-961929c6-98cc-4f99-b7f2-9e5e51171e06 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dd6eaa597d4b61b3c7f3719217baa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7dee7188943ae84823848038e5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:09.196051 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-961929c6-98cc-4f99-b7f2-9e5e51171e06 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] 10.222.0.58 "GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908" status: 200 len: 1313 microversion: 2.1 time: 0.170798 Mar 31 18:16:09.196605 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 154/326] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:09 2022] GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908 => generated 1313 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:09.550856 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-2f4963d5-8e09-4f50-a20b-50b0bd83b2fd tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:09.551382 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-2f4963d5-8e09-4f50-a20b-50b0bd83b2fd tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 779c13cd-7a7a-47b4-b488-0d1e365c3dc4] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:09.557651 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-2f4963d5-8e09-4f50-a20b-50b0bd83b2fd tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:09.558115 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-2f4963d5-8e09-4f50-a20b-50b0bd83b2fd tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:09.558950 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-2f4963d5-8e09-4f50-a20b-50b0bd83b2fd tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:09.559380 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-2f4963d5-8e09-4f50-a20b-50b0bd83b2fd tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:09.694679 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-2f4963d5-8e09-4f50-a20b-50b0bd83b2fd tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:09.702174 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-2f4963d5-8e09-4f50-a20b-50b0bd83b2fd tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4" status: 200 len: 1520 microversion: 2.1 time: 0.155099 Mar 31 18:16:09.702777 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 173/327] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:09 2022] GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:10.213320 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-56f5cc90-8a94-4094-bd04-d18b6d67b759 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:10.214014 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-56f5cc90-8a94-4094-bd04-d18b6d67b759 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 46c453cb-f20b-4389-9b6c-58852e5cd908] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:10.220040 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-56f5cc90-8a94-4094-bd04-d18b6d67b759 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:10.220478 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-56f5cc90-8a94-4094-bd04-d18b6d67b759 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:10.221432 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-56f5cc90-8a94-4094-bd04-d18b6d67b759 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:10.222016 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-56f5cc90-8a94-4094-bd04-d18b6d67b759 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:10.359434 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-56f5cc90-8a94-4094-bd04-d18b6d67b759 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dd6eaa597d4b61b3c7f3719217baa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7dee7188943ae84823848038e5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:10.367020 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-56f5cc90-8a94-4094-bd04-d18b6d67b759 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] 10.222.0.58 "GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908" status: 200 len: 1313 microversion: 2.1 time: 0.157505 Mar 31 18:16:10.367771 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 155/328] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:10 2022] GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:10.719663 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-5ff6a147-317f-4286-94e5-45d5d8f5bbd8 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:10.720346 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-5ff6a147-317f-4286-94e5-45d5d8f5bbd8 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 779c13cd-7a7a-47b4-b488-0d1e365c3dc4] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:10.731273 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-5ff6a147-317f-4286-94e5-45d5d8f5bbd8 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:10.731771 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-5ff6a147-317f-4286-94e5-45d5d8f5bbd8 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:10.732564 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-5ff6a147-317f-4286-94e5-45d5d8f5bbd8 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:10.733075 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-5ff6a147-317f-4286-94e5-45d5d8f5bbd8 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:10.881675 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-5ff6a147-317f-4286-94e5-45d5d8f5bbd8 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:10.889477 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-5ff6a147-317f-4286-94e5-45d5d8f5bbd8 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4" status: 200 len: 1520 microversion: 2.1 time: 0.174274 Mar 31 18:16:10.890096 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 174/329] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:10 2022] GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4 => generated 1520 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:11.383799 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-878a6c28-9865-472f-8c4c-79da004f749f tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:11.384485 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-878a6c28-9865-472f-8c4c-79da004f749f tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 46c453cb-f20b-4389-9b6c-58852e5cd908] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:11.390651 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-878a6c28-9865-472f-8c4c-79da004f749f tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:11.391085 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-878a6c28-9865-472f-8c4c-79da004f749f tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:11.391879 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-878a6c28-9865-472f-8c4c-79da004f749f tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:11.392304 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-878a6c28-9865-472f-8c4c-79da004f749f tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:11.554384 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-878a6c28-9865-472f-8c4c-79da004f749f tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dd6eaa597d4b61b3c7f3719217baa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7dee7188943ae84823848038e5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:11.562728 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-878a6c28-9865-472f-8c4c-79da004f749f tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] 10.222.0.58 "GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908" status: 200 len: 1313 microversion: 2.1 time: 0.182815 Mar 31 18:16:11.563551 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 156/330] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:11 2022] GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908 => generated 1313 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:11.908108 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-10b3bbaf-99c5-431b-8ece-6cd9e5ac4e52 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:11.908688 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-10b3bbaf-99c5-431b-8ece-6cd9e5ac4e52 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 779c13cd-7a7a-47b4-b488-0d1e365c3dc4] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:11.915723 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-10b3bbaf-99c5-431b-8ece-6cd9e5ac4e52 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:11.916097 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-10b3bbaf-99c5-431b-8ece-6cd9e5ac4e52 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:11.916868 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-10b3bbaf-99c5-431b-8ece-6cd9e5ac4e52 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:11.917294 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-10b3bbaf-99c5-431b-8ece-6cd9e5ac4e52 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:12.077984 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-10b3bbaf-99c5-431b-8ece-6cd9e5ac4e52 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:12.085414 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-10b3bbaf-99c5-431b-8ece-6cd9e5ac4e52 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4" status: 200 len: 1520 microversion: 2.1 time: 0.182004 Mar 31 18:16:12.085972 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 175/331] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:11 2022] GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4 => generated 1520 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:12.580387 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-24742660-254a-4f25-af09-d2bb041aee8f tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:12.580996 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-24742660-254a-4f25-af09-d2bb041aee8f tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 46c453cb-f20b-4389-9b6c-58852e5cd908] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:12.586918 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-24742660-254a-4f25-af09-d2bb041aee8f tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:12.587267 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-24742660-254a-4f25-af09-d2bb041aee8f tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:12.588029 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-24742660-254a-4f25-af09-d2bb041aee8f tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:12.588483 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-24742660-254a-4f25-af09-d2bb041aee8f tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:12.729414 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-24742660-254a-4f25-af09-d2bb041aee8f tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dd6eaa597d4b61b3c7f3719217baa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7dee7188943ae84823848038e5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:12.737184 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-24742660-254a-4f25-af09-d2bb041aee8f tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] 10.222.0.58 "GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908" status: 200 len: 1313 microversion: 2.1 time: 0.161078 Mar 31 18:16:12.737929 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 157/332] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:12 2022] GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:13.109128 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-4a0cea26-f084-4bf8-b501-2e16c5b6d6dc tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:13.109128 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-4a0cea26-f084-4bf8-b501-2e16c5b6d6dc tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 779c13cd-7a7a-47b4-b488-0d1e365c3dc4] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:13.112702 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4a0cea26-f084-4bf8-b501-2e16c5b6d6dc tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:13.113154 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4a0cea26-f084-4bf8-b501-2e16c5b6d6dc tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:13.113927 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4a0cea26-f084-4bf8-b501-2e16c5b6d6dc tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:13.114352 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4a0cea26-f084-4bf8-b501-2e16c5b6d6dc tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:13.257312 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-4a0cea26-f084-4bf8-b501-2e16c5b6d6dc tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:13.266243 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-4a0cea26-f084-4bf8-b501-2e16c5b6d6dc tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4" status: 200 len: 1500 microversion: 2.1 time: 0.166763 Mar 31 18:16:13.266930 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 176/333] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:13 2022] GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4 => generated 1500 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:13.287190 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-0912752a-4b43-4ebd-bc8d-1749a9cb101c tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f4a11036-bae4-48d2-91ea-bc522f66e1c7"}} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:16:13.288251 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-0912752a-4b43-4ebd-bc8d-1749a9cb101c tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 779c13cd-7a7a-47b4-b488-0d1e365c3dc4] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:13.296358 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0912752a-4b43-4ebd-bc8d-1749a9cb101c tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:13.298174 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0912752a-4b43-4ebd-bc8d-1749a9cb101c tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:13.298174 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0912752a-4b43-4ebd-bc8d-1749a9cb101c tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:13.298545 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0912752a-4b43-4ebd-bc8d-1749a9cb101c tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:13.324280 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.wsgi [None req-0912752a-4b43-4ebd-bc8d-1749a9cb101c tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] HTTP exception thrown: Cannot 'attach_volume' instance 779c13cd-7a7a-47b4-b488-0d1e365c3dc4 while it is in vm_state rescued Mar 31 18:16:13.324862 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-0912752a-4b43-4ebd-bc8d-1749a9cb101c tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Returning 409 to user: Cannot 'attach_volume' instance 779c13cd-7a7a-47b4-b488-0d1e365c3dc4 while it is in vm_state rescued {{(pid=117539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:16:13.325674 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-0912752a-4b43-4ebd-bc8d-1749a9cb101c tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "POST /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.042473 Mar 31 18:16:13.332619 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 158/334] 10.222.0.58 () {60 vars in 1322 bytes} [Thu Mar 31 18:16:13 2022] POST /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4/os-volume_attachments => generated 152 bytes in 47 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 31 18:16:13.336356 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-d8badc96-5a8b-4ebb-b540-69827cc1665a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:16:13.337142 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-d8badc96-5a8b-4ebb-b540-69827cc1665a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 779c13cd-7a7a-47b4-b488-0d1e365c3dc4] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:13.345900 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-d8badc96-5a8b-4ebb-b540-69827cc1665a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:13.346695 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-d8badc96-5a8b-4ebb-b540-69827cc1665a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:13.347776 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-d8badc96-5a8b-4ebb-b540-69827cc1665a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:13.348600 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-d8badc96-5a8b-4ebb-b540-69827cc1665a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:13.749907 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-d8badc96-5a8b-4ebb-b540-69827cc1665a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "POST /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4/action" status: 202 len: 0 microversion: 2.1 time: 0.418478 Mar 31 18:16:13.753796 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 177/335] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Mar 31 18:16:13 2022] POST /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4/action => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 31 18:16:13.754266 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-9ca2a080-8999-4da2-80dd-e2ab07675ab5 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:13.754770 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-9ca2a080-8999-4da2-80dd-e2ab07675ab5 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 46c453cb-f20b-4389-9b6c-58852e5cd908] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:13.759534 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-9529721b-88c1-4d32-9b7e-85af0b177952 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:13.760192 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-9529721b-88c1-4d32-9b7e-85af0b177952 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 779c13cd-7a7a-47b4-b488-0d1e365c3dc4] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:13.760562 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9ca2a080-8999-4da2-80dd-e2ab07675ab5 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:13.760983 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9ca2a080-8999-4da2-80dd-e2ab07675ab5 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:13.761741 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9ca2a080-8999-4da2-80dd-e2ab07675ab5 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:13.762168 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9ca2a080-8999-4da2-80dd-e2ab07675ab5 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:13.767454 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9529721b-88c1-4d32-9b7e-85af0b177952 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:13.767908 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9529721b-88c1-4d32-9b7e-85af0b177952 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:13.768671 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9529721b-88c1-4d32-9b7e-85af0b177952 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:13.769098 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9529721b-88c1-4d32-9b7e-85af0b177952 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:13.931367 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-9ca2a080-8999-4da2-80dd-e2ab07675ab5 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dd6eaa597d4b61b3c7f3719217baa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7dee7188943ae84823848038e5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:13.940672 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-9ca2a080-8999-4da2-80dd-e2ab07675ab5 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] 10.222.0.58 "GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908" status: 200 len: 1313 microversion: 2.1 time: 0.190188 Mar 31 18:16:13.941665 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 159/336] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:13 2022] GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908 => generated 1313 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:16:13.949942 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-9529721b-88c1-4d32-9b7e-85af0b177952 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:13.961904 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-9529721b-88c1-4d32-9b7e-85af0b177952 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4" status: 200 len: 1508 microversion: 2.1 time: 0.206644 Mar 31 18:16:13.962472 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 178/337] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:13 2022] GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4 => generated 1508 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:14.958689 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-3770f35c-0b58-4731-ae38-0d9c099058de tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:14.959377 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-3770f35c-0b58-4731-ae38-0d9c099058de tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 46c453cb-f20b-4389-9b6c-58852e5cd908] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:14.974542 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3770f35c-0b58-4731-ae38-0d9c099058de tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:14.975028 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3770f35c-0b58-4731-ae38-0d9c099058de tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:14.976618 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3770f35c-0b58-4731-ae38-0d9c099058de tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:14.977074 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3770f35c-0b58-4731-ae38-0d9c099058de tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:14.983215 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-f00eedaf-3f42-4eab-b4e1-9d57e0bf6616 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:14.984634 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-f00eedaf-3f42-4eab-b4e1-9d57e0bf6616 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 779c13cd-7a7a-47b4-b488-0d1e365c3dc4] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:14.993604 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f00eedaf-3f42-4eab-b4e1-9d57e0bf6616 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:14.994381 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f00eedaf-3f42-4eab-b4e1-9d57e0bf6616 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:14.995420 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f00eedaf-3f42-4eab-b4e1-9d57e0bf6616 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:14.996084 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f00eedaf-3f42-4eab-b4e1-9d57e0bf6616 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:15.204260 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-3770f35c-0b58-4731-ae38-0d9c099058de tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dd6eaa597d4b61b3c7f3719217baa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7dee7188943ae84823848038e5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:15.213972 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-3770f35c-0b58-4731-ae38-0d9c099058de tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] 10.222.0.58 "GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908" status: 200 len: 1313 microversion: 2.1 time: 0.260376 Mar 31 18:16:15.214853 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 160/338] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:14 2022] GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908 => generated 1313 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:15.237098 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-f00eedaf-3f42-4eab-b4e1-9d57e0bf6616 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:15.248681 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-f00eedaf-3f42-4eab-b4e1-9d57e0bf6616 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4" status: 200 len: 1508 microversion: 2.1 time: 0.266748 Mar 31 18:16:15.250171 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 179/339] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:14 2022] GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4 => generated 1508 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:15.745884 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [req-6ac9ebad-d92a-4a22-b983-8a9e37ed2e60 req-488ad067-7f3f-445a-8015-1e774227737b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46c453cb-f20b-4389-9b6c-58852e5cd908", "name": "network-vif-plugged", "status": "completed", "tag": "061db997-2b27-4a9a-9154-2a254b2384aa"}]} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:16:15.756210 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-6ac9ebad-d92a-4a22-b983-8a9e37ed2e60 req-488ad067-7f3f-445a-8015-1e774227737b service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:15.756641 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-6ac9ebad-d92a-4a22-b983-8a9e37ed2e60 req-488ad067-7f3f-445a-8015-1e774227737b service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:15.782708 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.compute.server_external_events [req-6ac9ebad-d92a-4a22-b983-8a9e37ed2e60 req-488ad067-7f3f-445a-8015-1e774227737b service nova] Creating event network-vif-plugged:061db997-2b27-4a9a-9154-2a254b2384aa for instance 46c453cb-f20b-4389-9b6c-58852e5cd908 on hv-cinder-maste Mar 31 18:16:15.782708 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [req-6ac9ebad-d92a-4a22-b983-8a9e37ed2e60 req-488ad067-7f3f-445a-8015-1e774227737b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039036 Mar 31 18:16:15.782708 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 161/340] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:16:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 31 18:16:16.230491 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-e05c2f85-36f3-41a3-8c02-e760e4fd1a18 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:16.231126 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-e05c2f85-36f3-41a3-8c02-e760e4fd1a18 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 46c453cb-f20b-4389-9b6c-58852e5cd908] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:16.237927 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e05c2f85-36f3-41a3-8c02-e760e4fd1a18 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:16.238372 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e05c2f85-36f3-41a3-8c02-e760e4fd1a18 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:16.239153 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e05c2f85-36f3-41a3-8c02-e760e4fd1a18 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:16.239587 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e05c2f85-36f3-41a3-8c02-e760e4fd1a18 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:16.269546 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-c9e9c746-0f82-4bb4-ac47-b048795602ac tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:16.270248 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-c9e9c746-0f82-4bb4-ac47-b048795602ac tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 779c13cd-7a7a-47b4-b488-0d1e365c3dc4] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:16.276727 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c9e9c746-0f82-4bb4-ac47-b048795602ac tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:16.277167 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c9e9c746-0f82-4bb4-ac47-b048795602ac tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:16.277927 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c9e9c746-0f82-4bb4-ac47-b048795602ac tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:16.278356 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c9e9c746-0f82-4bb4-ac47-b048795602ac tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:16.377739 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-e05c2f85-36f3-41a3-8c02-e760e4fd1a18 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dd6eaa597d4b61b3c7f3719217baa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7dee7188943ae84823848038e5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:16.385017 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-e05c2f85-36f3-41a3-8c02-e760e4fd1a18 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] 10.222.0.58 "GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908" status: 200 len: 1313 microversion: 2.1 time: 0.158315 Mar 31 18:16:16.385658 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 180/341] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:16 2022] GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:16.415953 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-c9e9c746-0f82-4bb4-ac47-b048795602ac tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:16.424046 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-c9e9c746-0f82-4bb4-ac47-b048795602ac tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4" status: 200 len: 1508 microversion: 2.1 time: 0.160301 Mar 31 18:16:16.424600 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 162/342] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:16 2022] GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4 => generated 1508 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:16:17.401610 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-e5c51a78-84f8-42f1-9274-3fa83526aa71 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:17.402216 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-e5c51a78-84f8-42f1-9274-3fa83526aa71 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 46c453cb-f20b-4389-9b6c-58852e5cd908] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:17.409259 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e5c51a78-84f8-42f1-9274-3fa83526aa71 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:17.409707 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e5c51a78-84f8-42f1-9274-3fa83526aa71 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:17.410467 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e5c51a78-84f8-42f1-9274-3fa83526aa71 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:17.410925 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e5c51a78-84f8-42f1-9274-3fa83526aa71 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:17.441026 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-9625628d-2367-4df0-af32-cbe59e46de4b tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:17.441661 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-9625628d-2367-4df0-af32-cbe59e46de4b tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 779c13cd-7a7a-47b4-b488-0d1e365c3dc4] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:17.447528 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9625628d-2367-4df0-af32-cbe59e46de4b tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:17.448014 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9625628d-2367-4df0-af32-cbe59e46de4b tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:17.448775 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9625628d-2367-4df0-af32-cbe59e46de4b tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:17.449194 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9625628d-2367-4df0-af32-cbe59e46de4b tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:17.588809 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-9625628d-2367-4df0-af32-cbe59e46de4b tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:17.596216 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-9625628d-2367-4df0-af32-cbe59e46de4b tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4" status: 200 len: 1508 microversion: 2.1 time: 0.158937 Mar 31 18:16:17.604556 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 163/343] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:17 2022] GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4 => generated 1508 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:16:17.679752 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-e5c51a78-84f8-42f1-9274-3fa83526aa71 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dd6eaa597d4b61b3c7f3719217baa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7dee7188943ae84823848038e5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:17.689549 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-e5c51a78-84f8-42f1-9274-3fa83526aa71 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] 10.222.0.58 "GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908" status: 200 len: 1313 microversion: 2.1 time: 0.292099 Mar 31 18:16:17.690410 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 181/344] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:17 2022] GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908 => generated 1313 bytes in 294 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:18.614138 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-891873b5-15b4-440f-a959-6b6ea8e670ac tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:18.614802 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-891873b5-15b4-440f-a959-6b6ea8e670ac tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 779c13cd-7a7a-47b4-b488-0d1e365c3dc4] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:18.620579 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-891873b5-15b4-440f-a959-6b6ea8e670ac tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:18.621020 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-891873b5-15b4-440f-a959-6b6ea8e670ac tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:18.621767 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-891873b5-15b4-440f-a959-6b6ea8e670ac tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:18.622197 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-891873b5-15b4-440f-a959-6b6ea8e670ac tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:18.706757 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-b426dc60-77ba-4fa4-91da-bf7a4a14bb82 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:18.707361 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-b426dc60-77ba-4fa4-91da-bf7a4a14bb82 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 46c453cb-f20b-4389-9b6c-58852e5cd908] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:18.715369 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b426dc60-77ba-4fa4-91da-bf7a4a14bb82 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:18.716048 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b426dc60-77ba-4fa4-91da-bf7a4a14bb82 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:18.716974 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b426dc60-77ba-4fa4-91da-bf7a4a14bb82 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:18.717401 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b426dc60-77ba-4fa4-91da-bf7a4a14bb82 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:18.785513 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-891873b5-15b4-440f-a959-6b6ea8e670ac tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:18.793945 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-891873b5-15b4-440f-a959-6b6ea8e670ac tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4" status: 200 len: 1508 microversion: 2.1 time: 0.183138 Mar 31 18:16:18.794679 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 164/345] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:18 2022] GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4 => generated 1508 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:18.890801 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-b426dc60-77ba-4fa4-91da-bf7a4a14bb82 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dd6eaa597d4b61b3c7f3719217baa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7dee7188943ae84823848038e5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:18.904312 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-b426dc60-77ba-4fa4-91da-bf7a4a14bb82 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] 10.222.0.58 "GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908" status: 200 len: 1313 microversion: 2.1 time: 0.196185 Mar 31 18:16:18.904312 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 182/346] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:18 2022] GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908 => generated 1313 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:16:19.811149 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-9c181669-cbca-4541-9c94-4c596f1ba64a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:19.811779 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-9c181669-cbca-4541-9c94-4c596f1ba64a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 779c13cd-7a7a-47b4-b488-0d1e365c3dc4] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:19.819215 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9c181669-cbca-4541-9c94-4c596f1ba64a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:19.819852 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9c181669-cbca-4541-9c94-4c596f1ba64a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:19.820660 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9c181669-cbca-4541-9c94-4c596f1ba64a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:19.821088 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9c181669-cbca-4541-9c94-4c596f1ba64a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:19.919125 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-39c9e826-f010-4024-93e3-2add5d1ce2c4 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:19.919969 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-39c9e826-f010-4024-93e3-2add5d1ce2c4 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 46c453cb-f20b-4389-9b6c-58852e5cd908] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:19.926493 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-39c9e826-f010-4024-93e3-2add5d1ce2c4 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:19.927308 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-39c9e826-f010-4024-93e3-2add5d1ce2c4 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:19.928399 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-39c9e826-f010-4024-93e3-2add5d1ce2c4 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:19.928909 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-39c9e826-f010-4024-93e3-2add5d1ce2c4 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:19.967346 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-9c181669-cbca-4541-9c94-4c596f1ba64a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:19.975163 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-9c181669-cbca-4541-9c94-4c596f1ba64a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4" status: 200 len: 1508 microversion: 2.1 time: 0.167988 Mar 31 18:16:19.976119 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 165/347] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:19 2022] GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4 => generated 1508 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:20.080809 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-39c9e826-f010-4024-93e3-2add5d1ce2c4 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dd6eaa597d4b61b3c7f3719217baa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7dee7188943ae84823848038e5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:20.089140 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-39c9e826-f010-4024-93e3-2add5d1ce2c4 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] 10.222.0.58 "GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908" status: 200 len: 1313 microversion: 2.1 time: 0.174152 Mar 31 18:16:20.089715 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 183/348] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:19 2022] GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908 => generated 1313 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:20.992457 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-deda5005-87ca-4af9-9ae6-ebbfa1a11013 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:20.993205 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-deda5005-87ca-4af9-9ae6-ebbfa1a11013 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 779c13cd-7a7a-47b4-b488-0d1e365c3dc4] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:20.999517 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-deda5005-87ca-4af9-9ae6-ebbfa1a11013 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:20.999963 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-deda5005-87ca-4af9-9ae6-ebbfa1a11013 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:21.000725 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-deda5005-87ca-4af9-9ae6-ebbfa1a11013 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:21.001178 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-deda5005-87ca-4af9-9ae6-ebbfa1a11013 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:21.108451 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-9108a9cf-e896-4a2d-8f61-4b61ffdb4f47 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:21.109065 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-9108a9cf-e896-4a2d-8f61-4b61ffdb4f47 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 46c453cb-f20b-4389-9b6c-58852e5cd908] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:21.115635 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9108a9cf-e896-4a2d-8f61-4b61ffdb4f47 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:21.116077 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9108a9cf-e896-4a2d-8f61-4b61ffdb4f47 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:21.116830 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9108a9cf-e896-4a2d-8f61-4b61ffdb4f47 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:21.117256 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9108a9cf-e896-4a2d-8f61-4b61ffdb4f47 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:21.134449 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-deda5005-87ca-4af9-9ae6-ebbfa1a11013 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:21.141549 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-deda5005-87ca-4af9-9ae6-ebbfa1a11013 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4" status: 200 len: 1508 microversion: 2.1 time: 0.153147 Mar 31 18:16:21.142115 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 166/349] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:20 2022] GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:21.253716 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-9108a9cf-e896-4a2d-8f61-4b61ffdb4f47 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dd6eaa597d4b61b3c7f3719217baa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7dee7188943ae84823848038e5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:21.261069 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-9108a9cf-e896-4a2d-8f61-4b61ffdb4f47 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] 10.222.0.58 "GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908" status: 200 len: 1496 microversion: 2.1 time: 0.157028 Mar 31 18:16:21.261638 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 184/350] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:21 2022] GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908 => generated 1496 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:16:22.159288 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-77743faa-98c6-4817-bc01-69c50638f81a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:22.159838 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-77743faa-98c6-4817-bc01-69c50638f81a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 779c13cd-7a7a-47b4-b488-0d1e365c3dc4] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:22.165627 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-77743faa-98c6-4817-bc01-69c50638f81a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:22.166061 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-77743faa-98c6-4817-bc01-69c50638f81a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:22.167036 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-77743faa-98c6-4817-bc01-69c50638f81a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:22.167464 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-77743faa-98c6-4817-bc01-69c50638f81a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:22.298062 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-77743faa-98c6-4817-bc01-69c50638f81a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:22.305214 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-77743faa-98c6-4817-bc01-69c50638f81a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4" status: 200 len: 1508 microversion: 2.1 time: 0.149925 Mar 31 18:16:22.305770 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 167/351] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:22 2022] GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4 => generated 1508 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:23.322946 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-742ea565-ec91-44c1-b852-de566ce8c544 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:23.323552 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-742ea565-ec91-44c1-b852-de566ce8c544 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 779c13cd-7a7a-47b4-b488-0d1e365c3dc4] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:23.329824 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-742ea565-ec91-44c1-b852-de566ce8c544 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:23.330268 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-742ea565-ec91-44c1-b852-de566ce8c544 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:23.331067 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-742ea565-ec91-44c1-b852-de566ce8c544 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:23.331498 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-742ea565-ec91-44c1-b852-de566ce8c544 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:23.462627 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-742ea565-ec91-44c1-b852-de566ce8c544 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:23.471191 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-742ea565-ec91-44c1-b852-de566ce8c544 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4" status: 200 len: 1508 microversion: 2.1 time: 0.152040 Mar 31 18:16:23.471760 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 185/352] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:23 2022] GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4 => generated 1508 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:24.488373 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-091b7036-3b88-40c2-9665-b346c6ddaade tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:24.488973 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-091b7036-3b88-40c2-9665-b346c6ddaade tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 779c13cd-7a7a-47b4-b488-0d1e365c3dc4] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:24.494828 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-091b7036-3b88-40c2-9665-b346c6ddaade tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:24.495268 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-091b7036-3b88-40c2-9665-b346c6ddaade tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:24.496035 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-091b7036-3b88-40c2-9665-b346c6ddaade tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:24.496457 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-091b7036-3b88-40c2-9665-b346c6ddaade tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:24.632183 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-091b7036-3b88-40c2-9665-b346c6ddaade tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:24.639499 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-091b7036-3b88-40c2-9665-b346c6ddaade tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4" status: 200 len: 1508 microversion: 2.1 time: 0.155048 Mar 31 18:16:24.640064 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 168/353] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:24 2022] GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:25.657159 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-149a3d2e-6438-4ab6-8eb2-72143d5544b3 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:25.657779 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-149a3d2e-6438-4ab6-8eb2-72143d5544b3 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 779c13cd-7a7a-47b4-b488-0d1e365c3dc4] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:25.664330 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-149a3d2e-6438-4ab6-8eb2-72143d5544b3 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:25.664768 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-149a3d2e-6438-4ab6-8eb2-72143d5544b3 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:25.665517 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-149a3d2e-6438-4ab6-8eb2-72143d5544b3 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:25.665946 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-149a3d2e-6438-4ab6-8eb2-72143d5544b3 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:25.800171 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-149a3d2e-6438-4ab6-8eb2-72143d5544b3 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:25.807313 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-149a3d2e-6438-4ab6-8eb2-72143d5544b3 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4" status: 200 len: 1508 microversion: 2.1 time: 0.154725 Mar 31 18:16:25.807871 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 186/354] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:25 2022] GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:26.824212 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-a4045267-7b9d-44a5-bd43-e950128cf8b7 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:26.825033 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-a4045267-7b9d-44a5-bd43-e950128cf8b7 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 779c13cd-7a7a-47b4-b488-0d1e365c3dc4] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:26.830855 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a4045267-7b9d-44a5-bd43-e950128cf8b7 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:26.831294 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a4045267-7b9d-44a5-bd43-e950128cf8b7 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:26.832039 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a4045267-7b9d-44a5-bd43-e950128cf8b7 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:26.832465 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a4045267-7b9d-44a5-bd43-e950128cf8b7 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:26.966163 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-a4045267-7b9d-44a5-bd43-e950128cf8b7 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:26.973401 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-a4045267-7b9d-44a5-bd43-e950128cf8b7 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4" status: 200 len: 1508 microversion: 2.1 time: 0.153042 Mar 31 18:16:26.973950 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 169/355] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:26 2022] GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:27.990824 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-bb2ac7a3-eedd-40ad-aa8c-01edf1a13941 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:27.991517 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-bb2ac7a3-eedd-40ad-aa8c-01edf1a13941 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 779c13cd-7a7a-47b4-b488-0d1e365c3dc4] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:27.997987 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-bb2ac7a3-eedd-40ad-aa8c-01edf1a13941 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:27.998461 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-bb2ac7a3-eedd-40ad-aa8c-01edf1a13941 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:27.999250 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-bb2ac7a3-eedd-40ad-aa8c-01edf1a13941 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:27.999682 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-bb2ac7a3-eedd-40ad-aa8c-01edf1a13941 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:28.133823 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-bb2ac7a3-eedd-40ad-aa8c-01edf1a13941 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:28.143676 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-bb2ac7a3-eedd-40ad-aa8c-01edf1a13941 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4" status: 200 len: 1508 microversion: 2.1 time: 0.156715 Mar 31 18:16:28.148524 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 187/356] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:27 2022] GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4 => generated 1508 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:29.161292 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-417f2a55-46db-4897-9dd2-49073750a3c2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:29.162017 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-417f2a55-46db-4897-9dd2-49073750a3c2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 779c13cd-7a7a-47b4-b488-0d1e365c3dc4] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:29.169131 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-417f2a55-46db-4897-9dd2-49073750a3c2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:29.169577 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-417f2a55-46db-4897-9dd2-49073750a3c2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:29.170354 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-417f2a55-46db-4897-9dd2-49073750a3c2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:29.171004 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-417f2a55-46db-4897-9dd2-49073750a3c2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:29.314739 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-417f2a55-46db-4897-9dd2-49073750a3c2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:29.322031 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-417f2a55-46db-4897-9dd2-49073750a3c2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4" status: 200 len: 1508 microversion: 2.1 time: 0.164553 Mar 31 18:16:29.322590 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 170/357] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:29 2022] GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4 => generated 1508 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:30.340320 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-f9045268-049b-48fd-beca-e660bdc12da2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:30.341011 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-f9045268-049b-48fd-beca-e660bdc12da2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 779c13cd-7a7a-47b4-b488-0d1e365c3dc4] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:30.347427 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f9045268-049b-48fd-beca-e660bdc12da2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:30.347872 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f9045268-049b-48fd-beca-e660bdc12da2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:30.348639 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f9045268-049b-48fd-beca-e660bdc12da2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:30.349078 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f9045268-049b-48fd-beca-e660bdc12da2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:30.483029 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-f9045268-049b-48fd-beca-e660bdc12da2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:30.490271 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-f9045268-049b-48fd-beca-e660bdc12da2 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4" status: 200 len: 1508 microversion: 2.1 time: 0.154381 Mar 31 18:16:30.490837 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 188/358] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:30 2022] GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4 => generated 1508 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:31.508267 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-726d2997-4162-43c0-91bd-2b75ef8640a3 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:31.508868 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-726d2997-4162-43c0-91bd-2b75ef8640a3 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 779c13cd-7a7a-47b4-b488-0d1e365c3dc4] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:31.514993 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-726d2997-4162-43c0-91bd-2b75ef8640a3 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:31.515426 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-726d2997-4162-43c0-91bd-2b75ef8640a3 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:31.516171 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-726d2997-4162-43c0-91bd-2b75ef8640a3 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:31.516594 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-726d2997-4162-43c0-91bd-2b75ef8640a3 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:31.649962 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-726d2997-4162-43c0-91bd-2b75ef8640a3 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:31.657688 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-726d2997-4162-43c0-91bd-2b75ef8640a3 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4" status: 200 len: 1508 microversion: 2.1 time: 0.153251 Mar 31 18:16:31.658242 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 171/359] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:31 2022] GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4 => generated 1508 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:32.675559 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-9dcfa754-692b-4c81-9009-5c3dcb59ecc9 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:32.676158 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-9dcfa754-692b-4c81-9009-5c3dcb59ecc9 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 779c13cd-7a7a-47b4-b488-0d1e365c3dc4] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:32.682457 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9dcfa754-692b-4c81-9009-5c3dcb59ecc9 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:32.682930 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9dcfa754-692b-4c81-9009-5c3dcb59ecc9 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:32.684455 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9dcfa754-692b-4c81-9009-5c3dcb59ecc9 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:32.684887 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9dcfa754-692b-4c81-9009-5c3dcb59ecc9 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:32.822268 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-9dcfa754-692b-4c81-9009-5c3dcb59ecc9 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:32.829987 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-9dcfa754-692b-4c81-9009-5c3dcb59ecc9 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4" status: 200 len: 1508 microversion: 2.1 time: 0.158303 Mar 31 18:16:32.830543 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 189/360] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:32 2022] GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4 => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:33.472681 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-c6435038-5b05-4bd3-928b-c052e855e8f7 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:33.473277 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-c6435038-5b05-4bd3-928b-c052e855e8f7 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 46c453cb-f20b-4389-9b6c-58852e5cd908] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:33.479041 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c6435038-5b05-4bd3-928b-c052e855e8f7 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:33.479475 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c6435038-5b05-4bd3-928b-c052e855e8f7 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:33.480418 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c6435038-5b05-4bd3-928b-c052e855e8f7 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:33.480858 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c6435038-5b05-4bd3-928b-c052e855e8f7 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:33.508427 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-c6435038-5b05-4bd3-928b-c052e855e8f7 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 46c453cb-f20b-4389-9b6c-58852e5cd908] Going to try to terminate instance {{(pid=117539) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 31 18:16:33.836392 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-c6435038-5b05-4bd3-928b-c052e855e8f7 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] 10.222.0.58 "DELETE /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908" status: 204 len: 0 microversion: 2.1 time: 0.367190 Mar 31 18:16:33.837489 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 172/361] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Mar 31 18:16:33 2022] DELETE /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 31 18:16:33.846476 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-11cfd8e2-9dd5-4c70-8f79-e68e884b5307 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:33.850818 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-11cfd8e2-9dd5-4c70-8f79-e68e884b5307 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 46c453cb-f20b-4389-9b6c-58852e5cd908] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:33.851553 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-6e7e2127-e8c8-4b2b-a1a0-fa1f955d399f tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:33.851553 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-6e7e2127-e8c8-4b2b-a1a0-fa1f955d399f tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 779c13cd-7a7a-47b4-b488-0d1e365c3dc4] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:33.855532 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-11cfd8e2-9dd5-4c70-8f79-e68e884b5307 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:33.855983 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-11cfd8e2-9dd5-4c70-8f79-e68e884b5307 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:33.856161 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-6e7e2127-e8c8-4b2b-a1a0-fa1f955d399f tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:33.856711 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-6e7e2127-e8c8-4b2b-a1a0-fa1f955d399f tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:33.856942 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-11cfd8e2-9dd5-4c70-8f79-e68e884b5307 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:33.857364 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-11cfd8e2-9dd5-4c70-8f79-e68e884b5307 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:33.857662 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-6e7e2127-e8c8-4b2b-a1a0-fa1f955d399f tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:33.858150 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-6e7e2127-e8c8-4b2b-a1a0-fa1f955d399f tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:34.010583 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-6e7e2127-e8c8-4b2b-a1a0-fa1f955d399f tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:34.020483 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-6e7e2127-e8c8-4b2b-a1a0-fa1f955d399f tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4" status: 200 len: 1514 microversion: 2.1 time: 0.177029 Mar 31 18:16:34.021319 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 173/362] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:33 2022] GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4 => generated 1514 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:34.034753 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-11cfd8e2-9dd5-4c70-8f79-e68e884b5307 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dd6eaa597d4b61b3c7f3719217baa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7dee7188943ae84823848038e5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:34.048085 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-11cfd8e2-9dd5-4c70-8f79-e68e884b5307 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] 10.222.0.58 "GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908" status: 200 len: 1502 microversion: 2.1 time: 0.205094 Mar 31 18:16:34.049069 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 190/363] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:33 2022] GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908 => generated 1502 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:16:35.067967 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-4773032e-64bc-4161-a40e-ec4d11791a18 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:35.068864 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-4773032e-64bc-4161-a40e-ec4d11791a18 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 46c453cb-f20b-4389-9b6c-58852e5cd908] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:35.075507 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-4773032e-64bc-4161-a40e-ec4d11791a18 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:35.075938 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-4773032e-64bc-4161-a40e-ec4d11791a18 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:35.076684 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-4773032e-64bc-4161-a40e-ec4d11791a18 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:35.077109 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-4773032e-64bc-4161-a40e-ec4d11791a18 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:35.211900 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-4773032e-64bc-4161-a40e-ec4d11791a18 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dd6eaa597d4b61b3c7f3719217baa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7dee7188943ae84823848038e5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:35.219703 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-4773032e-64bc-4161-a40e-ec4d11791a18 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] 10.222.0.58 "GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908" status: 200 len: 1502 microversion: 2.1 time: 0.156567 Mar 31 18:16:35.220255 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 174/364] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:35 2022] GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908 => generated 1502 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:36.237303 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-394f7d14-b3ca-49a4-bf00-aff8b094ea01 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:36.237928 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-394f7d14-b3ca-49a4-bf00-aff8b094ea01 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 46c453cb-f20b-4389-9b6c-58852e5cd908] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:36.244170 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-394f7d14-b3ca-49a4-bf00-aff8b094ea01 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:36.244613 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-394f7d14-b3ca-49a4-bf00-aff8b094ea01 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:36.245993 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-394f7d14-b3ca-49a4-bf00-aff8b094ea01 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:36.246421 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-394f7d14-b3ca-49a4-bf00-aff8b094ea01 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:36.383147 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-394f7d14-b3ca-49a4-bf00-aff8b094ea01 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dd6eaa597d4b61b3c7f3719217baa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7dee7188943ae84823848038e5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:36.390639 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-394f7d14-b3ca-49a4-bf00-aff8b094ea01 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] 10.222.0.58 "GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908" status: 200 len: 1502 microversion: 2.1 time: 0.157194 Mar 31 18:16:36.391198 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 191/365] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:36 2022] GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908 => generated 1502 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:37.407549 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-d57ff7f7-a2f1-4560-9274-d6bc35435193 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:37.408143 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-d57ff7f7-a2f1-4560-9274-d6bc35435193 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 46c453cb-f20b-4389-9b6c-58852e5cd908] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:37.413932 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-d57ff7f7-a2f1-4560-9274-d6bc35435193 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:37.414356 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-d57ff7f7-a2f1-4560-9274-d6bc35435193 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:37.415122 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-d57ff7f7-a2f1-4560-9274-d6bc35435193 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:37.415541 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-d57ff7f7-a2f1-4560-9274-d6bc35435193 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:37.545275 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-d57ff7f7-a2f1-4560-9274-d6bc35435193 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dd6eaa597d4b61b3c7f3719217baa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7dee7188943ae84823848038e5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:37.552377 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-d57ff7f7-a2f1-4560-9274-d6bc35435193 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] 10.222.0.58 "GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908" status: 200 len: 1502 microversion: 2.1 time: 0.148676 Mar 31 18:16:37.552919 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 175/366] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:37 2022] GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908 => generated 1502 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:38.569324 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-e6f2ded0-9aa6-40e0-9113-fe2b6bf50bdb tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:38.570067 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-e6f2ded0-9aa6-40e0-9113-fe2b6bf50bdb tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 46c453cb-f20b-4389-9b6c-58852e5cd908] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:38.582447 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e6f2ded0-9aa6-40e0-9113-fe2b6bf50bdb tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:38.582921 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e6f2ded0-9aa6-40e0-9113-fe2b6bf50bdb tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:38.583690 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e6f2ded0-9aa6-40e0-9113-fe2b6bf50bdb tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:38.584121 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e6f2ded0-9aa6-40e0-9113-fe2b6bf50bdb tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:38.835717 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-e6f2ded0-9aa6-40e0-9113-fe2b6bf50bdb tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dd6eaa597d4b61b3c7f3719217baa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7dee7188943ae84823848038e5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:38.843531 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-e6f2ded0-9aa6-40e0-9113-fe2b6bf50bdb tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] 10.222.0.58 "GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908" status: 200 len: 1502 microversion: 2.1 time: 0.278097 Mar 31 18:16:38.844098 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 192/367] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:38 2022] GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908 => generated 1502 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:39.860651 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-fb126a62-2c5f-4a93-8cb5-60e8f61c0eb0 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:39.861265 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-fb126a62-2c5f-4a93-8cb5-60e8f61c0eb0 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 46c453cb-f20b-4389-9b6c-58852e5cd908] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:39.867396 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-fb126a62-2c5f-4a93-8cb5-60e8f61c0eb0 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:39.868064 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-fb126a62-2c5f-4a93-8cb5-60e8f61c0eb0 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:39.868936 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-fb126a62-2c5f-4a93-8cb5-60e8f61c0eb0 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:39.869474 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-fb126a62-2c5f-4a93-8cb5-60e8f61c0eb0 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:40.019184 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-fb126a62-2c5f-4a93-8cb5-60e8f61c0eb0 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dd6eaa597d4b61b3c7f3719217baa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7dee7188943ae84823848038e5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:40.028394 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-fb126a62-2c5f-4a93-8cb5-60e8f61c0eb0 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] 10.222.0.58 "GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908" status: 200 len: 1502 microversion: 2.1 time: 0.171437 Mar 31 18:16:40.028987 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 176/368] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:39 2022] GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908 => generated 1502 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:16:41.046983 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-630d4d3d-eea5-40ad-89f8-6a1a462ca58a tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:41.047518 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-a0908499-d7b0-4f23-a13f-82ff8ebf1ab3 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Action: 'create', calling method: .version_select at 0x7fa4d45a7550>, body: {"keypair": {"name": "tempest-keypair-49036477"}} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:16:41.048558 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-630d4d3d-eea5-40ad-89f8-6a1a462ca58a tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 46c453cb-f20b-4389-9b6c-58852e5cd908] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:41.057656 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-630d4d3d-eea5-40ad-89f8-6a1a462ca58a tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:41.058112 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-630d4d3d-eea5-40ad-89f8-6a1a462ca58a tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:41.058911 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-630d4d3d-eea5-40ad-89f8-6a1a462ca58a tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:41.059542 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-630d4d3d-eea5-40ad-89f8-6a1a462ca58a tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:41.078373 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.quota [None req-a0908499-d7b0-4f23-a13f-82ff8ebf1ab3 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Getting quotas for project 6fc2eb72902a441ca6a6fa9350ce75f8. Resources: {'key_pairs'} {{(pid=117539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 31 18:16:41.082223 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.quota [None req-a0908499-d7b0-4f23-a13f-82ff8ebf1ab3 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Getting quotas for user d6a93e87d6894cfd9b7948274f1d7b70 and project 6fc2eb72902a441ca6a6fa9350ce75f8. Resources: {'key_pairs'} {{(pid=117539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 31 18:16:41.337911 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-630d4d3d-eea5-40ad-89f8-6a1a462ca58a tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dd6eaa597d4b61b3c7f3719217baa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7dee7188943ae84823848038e5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:41.358787 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-630d4d3d-eea5-40ad-89f8-6a1a462ca58a tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] 10.222.0.58 "GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908" status: 200 len: 1502 microversion: 2.1 time: 0.315640 Mar 31 18:16:41.359776 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 193/369] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:41 2022] GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908 => generated 1502 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:41.640932 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.quota [None req-a0908499-d7b0-4f23-a13f-82ff8ebf1ab3 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Getting quotas for project 6fc2eb72902a441ca6a6fa9350ce75f8. Resources: {'key_pairs'} {{(pid=117539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 31 18:16:41.640932 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.quota [None req-a0908499-d7b0-4f23-a13f-82ff8ebf1ab3 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Getting quotas for user d6a93e87d6894cfd9b7948274f1d7b70 and project 6fc2eb72902a441ca6a6fa9350ce75f8. Resources: {'key_pairs'} {{(pid=117539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 31 18:16:41.653814 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-a0908499-d7b0-4f23-a13f-82ff8ebf1ab3 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 2303 microversion: 2.1 time: 0.610828 Mar 31 18:16:41.654414 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 177/370] 10.222.0.58 () {60 vars in 1157 bytes} [Thu Mar 31 18:16:41 2022] POST /compute/v2.1/os-keypairs => generated 2303 bytes in 613 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:41.803534 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [req-f791ef11-c0f0-4ff4-80c7-57e1b73a8ee6 req-1fd9e761-4d47-4ba3-9a33-75f70c018016 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "46c453cb-f20b-4389-9b6c-58852e5cd908", "name": "network-vif-deleted", "tag": "061db997-2b27-4a9a-9154-2a254b2384aa"}]} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:16:41.816971 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-f791ef11-c0f0-4ff4-80c7-57e1b73a8ee6 req-1fd9e761-4d47-4ba3-9a33-75f70c018016 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:41.816971 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-f791ef11-c0f0-4ff4-80c7-57e1b73a8ee6 req-1fd9e761-4d47-4ba3-9a33-75f70c018016 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:41.824577 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.compute.server_external_events [req-f791ef11-c0f0-4ff4-80c7-57e1b73a8ee6 req-1fd9e761-4d47-4ba3-9a33-75f70c018016 service nova] Creating event network-vif-deleted:061db997-2b27-4a9a-9154-2a254b2384aa for instance 46c453cb-f20b-4389-9b6c-58852e5cd908 on hv-cinder-maste Mar 31 18:16:41.829764 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [req-f791ef11-c0f0-4ff4-80c7-57e1b73a8ee6 req-1fd9e761-4d47-4ba3-9a33-75f70c018016 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029975 Mar 31 18:16:41.830356 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 194/371] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:16:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:16:42.376682 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-63b73b6a-c696-450f-8f9e-f5eb66794e21 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:42.377312 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-63b73b6a-c696-450f-8f9e-f5eb66794e21 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 46c453cb-f20b-4389-9b6c-58852e5cd908] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:42.383119 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-63b73b6a-c696-450f-8f9e-f5eb66794e21 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:42.383552 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-63b73b6a-c696-450f-8f9e-f5eb66794e21 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:42.384321 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-63b73b6a-c696-450f-8f9e-f5eb66794e21 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:42.384748 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-63b73b6a-c696-450f-8f9e-f5eb66794e21 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:42.414504 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-63b73b6a-c696-450f-8f9e-f5eb66794e21 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:42.414869 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-63b73b6a-c696-450f-8f9e-f5eb66794e21 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:42.415301 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.objects.instance [None req-63b73b6a-c696-450f-8f9e-f5eb66794e21 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lazy-loading 'fault' on Instance uuid 46c453cb-f20b-4389-9b6c-58852e5cd908 {{(pid=117539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 31 18:16:42.461488 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-63b73b6a-c696-450f-8f9e-f5eb66794e21 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dd6eaa597d4b61b3c7f3719217baa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7dee7188943ae84823848038e5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:42.478160 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-63b73b6a-c696-450f-8f9e-f5eb66794e21 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] 10.222.0.58 "GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908" status: 200 len: 1303 microversion: 2.1 time: 0.105064 Mar 31 18:16:42.478477 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 178/372] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:42 2022] GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908 => generated 1303 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:43.504511 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-bea13568-329a-4467-ba5e-7732ec0085be tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:43.505770 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-bea13568-329a-4467-ba5e-7732ec0085be tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 46c453cb-f20b-4389-9b6c-58852e5cd908] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:43.515330 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-bea13568-329a-4467-ba5e-7732ec0085be tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:43.516080 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-bea13568-329a-4467-ba5e-7732ec0085be tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:43.517901 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-bea13568-329a-4467-ba5e-7732ec0085be tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:43.518668 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-bea13568-329a-4467-ba5e-7732ec0085be tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:43.533103 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.wsgi [None req-bea13568-329a-4467-ba5e-7732ec0085be tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] HTTP exception thrown: Instance 46c453cb-f20b-4389-9b6c-58852e5cd908 could not be found. Mar 31 18:16:43.533861 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-bea13568-329a-4467-ba5e-7732ec0085be tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Returning 404 to user: Instance 46c453cb-f20b-4389-9b6c-58852e5cd908 could not be found. {{(pid=117538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:16:43.534716 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-bea13568-329a-4467-ba5e-7732ec0085be tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] 10.222.0.58 "GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908" status: 404 len: 111 microversion: 2.1 time: 0.035807 Mar 31 18:16:43.535267 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 195/373] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:43 2022] GET /compute/v2.1/servers/46c453cb-f20b-4389-9b6c-58852e5cd908 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 31 18:16:43.644634 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-ca8e659f-c51b-44dd-b074-e878b857349c tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1529748983", "imageRef": "6241b999-6f6d-4076-88bc-345fa7386256", "flavorRef": "452", "networks": [{"uuid": "6985b94c-578f-440f-adb1-d40b9aefd2a5"}]}} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:16:43.717178 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.network.neutron [None req-ca8e659f-c51b-44dd-b074-e878b857349c tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] validate_networks() for [('6985b94c-578f-440f-adb1-d40b9aefd2a5', None, None, None, None, None)] {{(pid=117539) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 31 18:16:44.389925 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.virt.hardware [None req-ca8e659f-c51b-44dd-b074-e878b857349c tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Flavor limits 0:0:0 {{(pid=117539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 31 18:16:44.390336 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.virt.hardware [None req-ca8e659f-c51b-44dd-b074-e878b857349c tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Image limits 0:0:0 {{(pid=117539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 31 18:16:44.390898 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.virt.hardware [None req-ca8e659f-c51b-44dd-b074-e878b857349c tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Flavor pref 0:0:0 {{(pid=117539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 31 18:16:44.391302 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.virt.hardware [None req-ca8e659f-c51b-44dd-b074-e878b857349c tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Image pref 0:0:0 {{(pid=117539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 31 18:16:44.391721 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.virt.hardware [None req-ca8e659f-c51b-44dd-b074-e878b857349c tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 31 18:16:44.402395 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ca8e659f-c51b-44dd-b074-e878b857349c tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:44.402872 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ca8e659f-c51b-44dd-b074-e878b857349c tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:44.403658 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ca8e659f-c51b-44dd-b074-e878b857349c tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:44.404083 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ca8e659f-c51b-44dd-b074-e878b857349c tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:44.421368 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.quota [None req-ca8e659f-c51b-44dd-b074-e878b857349c tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Getting quotas for project b2d7dee7188943ae84823848038e5357. Resources: {'instances', 'ram', 'cores'} {{(pid=117539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 31 18:16:44.425977 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.quota [None req-ca8e659f-c51b-44dd-b074-e878b857349c tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Getting quotas for user 37dd6eaa597d4b61b3c7f3719217baa1 and project b2d7dee7188943ae84823848038e5357. Resources: {'instances', 'ram', 'cores'} {{(pid=117539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 31 18:16:44.437020 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-ca8e659f-c51b-44dd-b074-e878b857349c tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Going to run 1 instances... {{(pid=117539) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 31 18:16:44.439368 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-ca8e659f-c51b-44dd-b074-e878b857349c tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6241b999-6f6d-4076-88bc-345fa7386256',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 31 18:16:44.723824 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-ca8e659f-c51b-44dd-b074-e878b857349c tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.086070 Mar 31 18:16:44.729577 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 179/374] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Mar 31 18:16:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 1088 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 31 18:16:44.734548 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-819645a9-5a79-453f-b91c-1f05bd7b5df8 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:44.735193 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-819645a9-5a79-453f-b91c-1f05bd7b5df8 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:44.795451 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-819645a9-5a79-453f-b91c-1f05bd7b5df8 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dd6eaa597d4b61b3c7f3719217baa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7dee7188943ae84823848038e5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:44.802079 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-819645a9-5a79-453f-b91c-1f05bd7b5df8 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] 10.222.0.58 "GET /compute/v2.1/servers/0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0" status: 200 len: 1214 microversion: 2.1 time: 0.071296 Mar 31 18:16:44.802643 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 196/375] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:44 2022] GET /compute/v2.1/servers/0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0 => generated 1214 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:16:45.190798 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-d897bf99-232d-4009-8cfa-b11af8199413 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1356017267", "imageRef": "6241b999-6f6d-4076-88bc-345fa7386256", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fca50c83-3b91-4a03-8e1d-d873f4d904c1"}], "security_groups": [{"name": "tempest-securitygroup--1858206256"}], "key_name": "tempest-keypair-49036477", "user_data": "}} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:16:45.323679 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.network.neutron [None req-d897bf99-232d-4009-8cfa-b11af8199413 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] validate_networks() for [('fca50c83-3b91-4a03-8e1d-d873f4d904c1', None, None, None, None, None)] {{(pid=117539) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 31 18:16:45.825476 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-9dd8bdac-c061-44b3-8958-4f3ceacf3789 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:45.825476 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-9dd8bdac-c061-44b3-8958-4f3ceacf3789 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:45.835847 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9dd8bdac-c061-44b3-8958-4f3ceacf3789 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:45.837205 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9dd8bdac-c061-44b3-8958-4f3ceacf3789 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:45.839455 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9dd8bdac-c061-44b3-8958-4f3ceacf3789 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:45.839610 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9dd8bdac-c061-44b3-8958-4f3ceacf3789 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:45.874143 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.virt.hardware [None req-d897bf99-232d-4009-8cfa-b11af8199413 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Flavor limits 0:0:0 {{(pid=117539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 31 18:16:45.874823 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.virt.hardware [None req-d897bf99-232d-4009-8cfa-b11af8199413 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Image limits 0:0:0 {{(pid=117539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 31 18:16:45.875131 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.virt.hardware [None req-d897bf99-232d-4009-8cfa-b11af8199413 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Flavor pref 0:0:0 {{(pid=117539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 31 18:16:45.876452 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.virt.hardware [None req-d897bf99-232d-4009-8cfa-b11af8199413 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Image pref 0:0:0 {{(pid=117539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 31 18:16:45.876810 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.virt.hardware [None req-d897bf99-232d-4009-8cfa-b11af8199413 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 31 18:16:45.887019 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-d897bf99-232d-4009-8cfa-b11af8199413 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:45.887454 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-d897bf99-232d-4009-8cfa-b11af8199413 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:45.888271 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-d897bf99-232d-4009-8cfa-b11af8199413 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:45.888746 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-d897bf99-232d-4009-8cfa-b11af8199413 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:45.912297 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.quota [None req-d897bf99-232d-4009-8cfa-b11af8199413 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Getting quotas for project 6fc2eb72902a441ca6a6fa9350ce75f8. Resources: {'instances', 'ram', 'cores'} {{(pid=117539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 31 18:16:45.917019 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.quota [None req-d897bf99-232d-4009-8cfa-b11af8199413 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Getting quotas for user d6a93e87d6894cfd9b7948274f1d7b70 and project 6fc2eb72902a441ca6a6fa9350ce75f8. Resources: {'instances', 'ram', 'cores'} {{(pid=117539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 31 18:16:45.934783 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-d897bf99-232d-4009-8cfa-b11af8199413 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Going to run 1 instances... {{(pid=117539) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 31 18:16:45.937068 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-d897bf99-232d-4009-8cfa-b11af8199413 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: a2498a53-f6d8-4236-8788-289622fc2c88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6241b999-6f6d-4076-88bc-345fa7386256',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 31 18:16:45.971330 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-9dd8bdac-c061-44b3-8958-4f3ceacf3789 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dd6eaa597d4b61b3c7f3719217baa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7dee7188943ae84823848038e5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:45.979078 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-9dd8bdac-c061-44b3-8958-4f3ceacf3789 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] 10.222.0.58 "GET /compute/v2.1/servers/0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0" status: 200 len: 1218 microversion: 2.1 time: 0.161209 Mar 31 18:16:45.979647 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 197/376] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:45 2022] GET /compute/v2.1/servers/0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0 => generated 1218 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:46.082925 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-d897bf99-232d-4009-8cfa-b11af8199413 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 0.897683 Mar 31 18:16:46.083845 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 180/377] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Mar 31 18:16:45 2022] POST /compute/v2.1/servers => generated 409 bytes in 899 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 31 18:16:46.093960 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-1f217f34-8704-4f81-8343-b4bcb23796f3 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:46.094812 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-1f217f34-8704-4f81-8343-b4bcb23796f3 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: a2498a53-f6d8-4236-8788-289622fc2c88] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:46.148233 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-1f217f34-8704-4f81-8343-b4bcb23796f3 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:46.156105 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-1f217f34-8704-4f81-8343-b4bcb23796f3 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88" status: 200 len: 1244 microversion: 2.1 time: 0.065866 Mar 31 18:16:46.158408 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 198/378] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:46 2022] GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88 => generated 1244 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:46.997551 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-dfc147df-e453-42f6-ab3a-5318dc84e8b8 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:46.998279 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-dfc147df-e453-42f6-ab3a-5318dc84e8b8 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:47.004429 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-dfc147df-e453-42f6-ab3a-5318dc84e8b8 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:47.004879 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-dfc147df-e453-42f6-ab3a-5318dc84e8b8 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:47.005640 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-dfc147df-e453-42f6-ab3a-5318dc84e8b8 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:47.006070 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-dfc147df-e453-42f6-ab3a-5318dc84e8b8 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:47.068974 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-dfc147df-e453-42f6-ab3a-5318dc84e8b8 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dd6eaa597d4b61b3c7f3719217baa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7dee7188943ae84823848038e5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:47.078966 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-dfc147df-e453-42f6-ab3a-5318dc84e8b8 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] 10.222.0.58 "GET /compute/v2.1/servers/0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0" status: 200 len: 1266 microversion: 2.1 time: 0.084396 Mar 31 18:16:47.078966 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 181/379] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:46 2022] GET /compute/v2.1/servers/0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0 => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:47.174628 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-9c216afb-aa73-4fef-98f9-2d27c669b324 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:47.177588 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-9c216afb-aa73-4fef-98f9-2d27c669b324 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: a2498a53-f6d8-4236-8788-289622fc2c88] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:47.184468 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9c216afb-aa73-4fef-98f9-2d27c669b324 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:47.184918 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9c216afb-aa73-4fef-98f9-2d27c669b324 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:47.185853 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9c216afb-aa73-4fef-98f9-2d27c669b324 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:47.186286 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9c216afb-aa73-4fef-98f9-2d27c669b324 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:47.254077 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-9c216afb-aa73-4fef-98f9-2d27c669b324 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:47.261744 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-9c216afb-aa73-4fef-98f9-2d27c669b324 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88" status: 200 len: 1248 microversion: 2.1 time: 0.091558 Mar 31 18:16:47.262512 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 199/380] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:47 2022] GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88 => generated 1248 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:48.093901 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-d1a61a14-2e88-4e56-81a5-d5add935a682 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:48.094505 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-d1a61a14-2e88-4e56-81a5-d5add935a682 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:48.108599 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-d1a61a14-2e88-4e56-81a5-d5add935a682 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:48.109282 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-d1a61a14-2e88-4e56-81a5-d5add935a682 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:48.110290 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-d1a61a14-2e88-4e56-81a5-d5add935a682 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:48.110958 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-d1a61a14-2e88-4e56-81a5-d5add935a682 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:48.182909 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-d1a61a14-2e88-4e56-81a5-d5add935a682 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dd6eaa597d4b61b3c7f3719217baa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7dee7188943ae84823848038e5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:48.190581 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-d1a61a14-2e88-4e56-81a5-d5add935a682 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] 10.222.0.58 "GET /compute/v2.1/servers/0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0" status: 200 len: 1272 microversion: 2.1 time: 0.100553 Mar 31 18:16:48.191709 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 182/381] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:48 2022] GET /compute/v2.1/servers/0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0 => generated 1272 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:48.280007 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-f9a7ff0e-d286-40e1-ab14-914c21d10c26 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:48.281106 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-f9a7ff0e-d286-40e1-ab14-914c21d10c26 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: a2498a53-f6d8-4236-8788-289622fc2c88] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:48.287015 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f9a7ff0e-d286-40e1-ab14-914c21d10c26 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:48.287715 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f9a7ff0e-d286-40e1-ab14-914c21d10c26 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:48.288702 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f9a7ff0e-d286-40e1-ab14-914c21d10c26 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:48.289359 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f9a7ff0e-d286-40e1-ab14-914c21d10c26 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:48.360061 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-f9a7ff0e-d286-40e1-ab14-914c21d10c26 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:48.367413 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-f9a7ff0e-d286-40e1-ab14-914c21d10c26 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88" status: 200 len: 1296 microversion: 2.1 time: 0.092564 Mar 31 18:16:48.368365 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 200/382] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:48 2022] GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88 => generated 1296 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:49.212908 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-a8059037-1175-4ff8-a32f-082f4a617dda tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:49.221492 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-a8059037-1175-4ff8-a32f-082f4a617dda tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:49.225365 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a8059037-1175-4ff8-a32f-082f4a617dda tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:49.225815 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a8059037-1175-4ff8-a32f-082f4a617dda tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:49.228861 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a8059037-1175-4ff8-a32f-082f4a617dda tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:49.229457 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a8059037-1175-4ff8-a32f-082f4a617dda tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:49.385385 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-aaae9a95-ad36-4f56-8b0b-a9088f70538d tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:49.386575 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-aaae9a95-ad36-4f56-8b0b-a9088f70538d tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: a2498a53-f6d8-4236-8788-289622fc2c88] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:49.402133 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-aaae9a95-ad36-4f56-8b0b-a9088f70538d tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:49.402346 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-aaae9a95-ad36-4f56-8b0b-a9088f70538d tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:49.403404 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-aaae9a95-ad36-4f56-8b0b-a9088f70538d tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:49.404000 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-aaae9a95-ad36-4f56-8b0b-a9088f70538d tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:49.493195 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-a8059037-1175-4ff8-a32f-082f4a617dda tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dd6eaa597d4b61b3c7f3719217baa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7dee7188943ae84823848038e5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:49.493837 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-aaae9a95-ad36-4f56-8b0b-a9088f70538d tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:49.501562 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-aaae9a95-ad36-4f56-8b0b-a9088f70538d tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88" status: 200 len: 1302 microversion: 2.1 time: 0.120137 Mar 31 18:16:49.502295 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 201/383] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:49 2022] GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88 => generated 1302 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:16:49.502422 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-a8059037-1175-4ff8-a32f-082f4a617dda tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] 10.222.0.58 "GET /compute/v2.1/servers/0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0" status: 200 len: 1314 microversion: 2.1 time: 0.293632 Mar 31 18:16:49.503140 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 183/384] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:49 2022] GET /compute/v2.1/servers/0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0 => generated 1314 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:50.287850 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [req-a17da6c0-ac99-49c1-a179-a466e901ff69 req-316c8b34-9e61-42fb-a957-307c29685a13 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0", "tag": "86623eca-526d-4e62-a3a8-2d929a18df20"}]} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:16:50.297440 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-a17da6c0-ac99-49c1-a179-a466e901ff69 req-316c8b34-9e61-42fb-a957-307c29685a13 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:50.301943 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-a17da6c0-ac99-49c1-a179-a466e901ff69 req-316c8b34-9e61-42fb-a957-307c29685a13 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:50.317886 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.compute.server_external_events [req-a17da6c0-ac99-49c1-a179-a466e901ff69 req-316c8b34-9e61-42fb-a957-307c29685a13 service nova] Creating event network-changed:86623eca-526d-4e62-a3a8-2d929a18df20 for instance 0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0 on hv-cinder-maste Mar 31 18:16:50.324421 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [req-a17da6c0-ac99-49c1-a179-a466e901ff69 req-316c8b34-9e61-42fb-a957-307c29685a13 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039911 Mar 31 18:16:50.325843 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 202/385] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:16:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:16:50.519003 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-61f2f14f-089c-4f43-ab5a-f54d17c954be tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:50.520381 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-b4cb0f9c-f51b-4dfd-bf23-477613894944 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:50.521323 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-b4cb0f9c-f51b-4dfd-bf23-477613894944 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:50.521453 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-61f2f14f-089c-4f43-ab5a-f54d17c954be tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: a2498a53-f6d8-4236-8788-289622fc2c88] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:50.529108 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b4cb0f9c-f51b-4dfd-bf23-477613894944 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:50.534966 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b4cb0f9c-f51b-4dfd-bf23-477613894944 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:50.534966 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b4cb0f9c-f51b-4dfd-bf23-477613894944 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:50.534966 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b4cb0f9c-f51b-4dfd-bf23-477613894944 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:50.551097 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-61f2f14f-089c-4f43-ab5a-f54d17c954be tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:50.551677 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-61f2f14f-089c-4f43-ab5a-f54d17c954be tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:50.554859 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-61f2f14f-089c-4f43-ab5a-f54d17c954be tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:50.555409 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-61f2f14f-089c-4f43-ab5a-f54d17c954be tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:50.746756 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-61f2f14f-089c-4f43-ab5a-f54d17c954be tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:50.755013 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-61f2f14f-089c-4f43-ab5a-f54d17c954be tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88" status: 200 len: 1370 microversion: 2.1 time: 0.239361 Mar 31 18:16:50.756181 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 184/386] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:50 2022] GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88 => generated 1370 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:50.909610 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-b4cb0f9c-f51b-4dfd-bf23-477613894944 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dd6eaa597d4b61b3c7f3719217baa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7dee7188943ae84823848038e5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:50.919547 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-b4cb0f9c-f51b-4dfd-bf23-477613894944 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] 10.222.0.58 "GET /compute/v2.1/servers/0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0" status: 200 len: 1314 microversion: 2.1 time: 0.403099 Mar 31 18:16:50.929841 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 203/387] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:50 2022] GET /compute/v2.1/servers/0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0 => generated 1314 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:16:51.774122 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-481f0a80-1a63-44a3-abf4-493d2c7ac100 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:51.774956 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-481f0a80-1a63-44a3-abf4-493d2c7ac100 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: a2498a53-f6d8-4236-8788-289622fc2c88] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:51.782343 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-481f0a80-1a63-44a3-abf4-493d2c7ac100 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:51.782986 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-481f0a80-1a63-44a3-abf4-493d2c7ac100 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:51.783991 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-481f0a80-1a63-44a3-abf4-493d2c7ac100 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:51.784805 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-481f0a80-1a63-44a3-abf4-493d2c7ac100 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:51.936954 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-4653f228-3601-4627-b3b6-ce9adf90231d tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:51.937503 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-4653f228-3601-4627-b3b6-ce9adf90231d tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:51.950330 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4653f228-3601-4627-b3b6-ce9adf90231d tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:51.950330 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4653f228-3601-4627-b3b6-ce9adf90231d tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:51.950330 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4653f228-3601-4627-b3b6-ce9adf90231d tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:51.950330 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4653f228-3601-4627-b3b6-ce9adf90231d tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:52.048765 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-481f0a80-1a63-44a3-abf4-493d2c7ac100 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:52.059555 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-481f0a80-1a63-44a3-abf4-493d2c7ac100 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88" status: 200 len: 1370 microversion: 2.1 time: 0.290272 Mar 31 18:16:52.061066 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 185/388] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:51 2022] GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88 => generated 1370 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:52.179094 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-4653f228-3601-4627-b3b6-ce9adf90231d tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dd6eaa597d4b61b3c7f3719217baa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7dee7188943ae84823848038e5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:52.203522 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-4653f228-3601-4627-b3b6-ce9adf90231d tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] 10.222.0.58 "GET /compute/v2.1/servers/0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0" status: 200 len: 1314 microversion: 2.1 time: 0.270410 Mar 31 18:16:52.204110 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 204/389] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:51 2022] GET /compute/v2.1/servers/0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0 => generated 1314 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:16:52.353764 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [req-9075f509-9fa6-49f5-8c95-e4853ea7aa50 req-9f06325e-d207-452e-a852-2efb4b4b3f1f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2498a53-f6d8-4236-8788-289622fc2c88", "tag": "5510c46b-9407-41b3-b02d-dbe7f958b08c"}]} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:16:52.361991 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-9075f509-9fa6-49f5-8c95-e4853ea7aa50 req-9f06325e-d207-452e-a852-2efb4b4b3f1f service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:52.362420 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-9075f509-9fa6-49f5-8c95-e4853ea7aa50 req-9f06325e-d207-452e-a852-2efb4b4b3f1f service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:52.374496 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.compute.server_external_events [req-9075f509-9fa6-49f5-8c95-e4853ea7aa50 req-9f06325e-d207-452e-a852-2efb4b4b3f1f service nova] Creating event network-changed:5510c46b-9407-41b3-b02d-dbe7f958b08c for instance a2498a53-f6d8-4236-8788-289622fc2c88 on hv-cinder-maste Mar 31 18:16:52.379746 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [req-9075f509-9fa6-49f5-8c95-e4853ea7aa50 req-9f06325e-d207-452e-a852-2efb4b4b3f1f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030140 Mar 31 18:16:52.380803 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 186/390] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:16:53.077711 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-e5047013-db29-4237-9b12-bb54852685a7 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:53.078323 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-e5047013-db29-4237-9b12-bb54852685a7 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: a2498a53-f6d8-4236-8788-289622fc2c88] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:53.085679 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e5047013-db29-4237-9b12-bb54852685a7 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:53.086271 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e5047013-db29-4237-9b12-bb54852685a7 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:53.088776 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e5047013-db29-4237-9b12-bb54852685a7 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:53.088776 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e5047013-db29-4237-9b12-bb54852685a7 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:53.222581 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-15174c06-0ea2-443b-a96e-e01cb5925cd4 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:53.225194 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-15174c06-0ea2-443b-a96e-e01cb5925cd4 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:53.231135 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-15174c06-0ea2-443b-a96e-e01cb5925cd4 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:53.231500 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-15174c06-0ea2-443b-a96e-e01cb5925cd4 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:53.232251 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-15174c06-0ea2-443b-a96e-e01cb5925cd4 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:53.232671 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-15174c06-0ea2-443b-a96e-e01cb5925cd4 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:53.327861 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-e5047013-db29-4237-9b12-bb54852685a7 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:53.335987 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-e5047013-db29-4237-9b12-bb54852685a7 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88" status: 200 len: 1370 microversion: 2.1 time: 0.262705 Mar 31 18:16:53.337573 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 205/391] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:53 2022] GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88 => generated 1370 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:53.394600 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-15174c06-0ea2-443b-a96e-e01cb5925cd4 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dd6eaa597d4b61b3c7f3719217baa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7dee7188943ae84823848038e5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:53.404974 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-15174c06-0ea2-443b-a96e-e01cb5925cd4 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] 10.222.0.58 "GET /compute/v2.1/servers/0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0" status: 200 len: 1314 microversion: 2.1 time: 0.188010 Mar 31 18:16:53.405649 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 187/392] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:53 2022] GET /compute/v2.1/servers/0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0 => generated 1314 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:54.353667 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-89933da3-3e88-459e-99b8-d2c6e5da5974 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:54.354266 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-89933da3-3e88-459e-99b8-d2c6e5da5974 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: a2498a53-f6d8-4236-8788-289622fc2c88] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:54.360650 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-89933da3-3e88-459e-99b8-d2c6e5da5974 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:54.361096 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-89933da3-3e88-459e-99b8-d2c6e5da5974 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:54.361863 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-89933da3-3e88-459e-99b8-d2c6e5da5974 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:54.362295 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-89933da3-3e88-459e-99b8-d2c6e5da5974 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:54.421740 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-1a9cc903-e971-4165-90ae-465a608d6245 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:54.422353 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-1a9cc903-e971-4165-90ae-465a608d6245 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:54.428534 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1a9cc903-e971-4165-90ae-465a608d6245 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:54.429072 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1a9cc903-e971-4165-90ae-465a608d6245 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:54.429898 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1a9cc903-e971-4165-90ae-465a608d6245 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:54.431183 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1a9cc903-e971-4165-90ae-465a608d6245 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:54.506560 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-89933da3-3e88-459e-99b8-d2c6e5da5974 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:54.512859 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-89933da3-3e88-459e-99b8-d2c6e5da5974 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88" status: 200 len: 1370 microversion: 2.1 time: 0.163581 Mar 31 18:16:54.513425 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 206/393] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:54 2022] GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88 => generated 1370 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:54.565493 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-1a9cc903-e971-4165-90ae-465a608d6245 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dd6eaa597d4b61b3c7f3719217baa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7dee7188943ae84823848038e5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:54.572793 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-1a9cc903-e971-4165-90ae-465a608d6245 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] 10.222.0.58 "GET /compute/v2.1/servers/0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0" status: 200 len: 1314 microversion: 2.1 time: 0.154885 Mar 31 18:16:54.573395 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 188/394] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:54 2022] GET /compute/v2.1/servers/0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:16:55.529946 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-b1e04873-a94b-4bd3-ab36-73b573741069 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:55.530549 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-b1e04873-a94b-4bd3-ab36-73b573741069 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: a2498a53-f6d8-4236-8788-289622fc2c88] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:55.536724 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b1e04873-a94b-4bd3-ab36-73b573741069 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:55.537161 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b1e04873-a94b-4bd3-ab36-73b573741069 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:55.537964 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b1e04873-a94b-4bd3-ab36-73b573741069 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:55.538454 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b1e04873-a94b-4bd3-ab36-73b573741069 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:55.589593 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-890c5048-ed1a-4dcd-b5b6-ff3edcc80eda tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:55.590254 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-890c5048-ed1a-4dcd-b5b6-ff3edcc80eda tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:55.600344 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-890c5048-ed1a-4dcd-b5b6-ff3edcc80eda tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:55.601209 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-890c5048-ed1a-4dcd-b5b6-ff3edcc80eda tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:55.602881 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-890c5048-ed1a-4dcd-b5b6-ff3edcc80eda tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:55.603742 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-890c5048-ed1a-4dcd-b5b6-ff3edcc80eda tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:55.692343 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-b1e04873-a94b-4bd3-ab36-73b573741069 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:55.700865 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-b1e04873-a94b-4bd3-ab36-73b573741069 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88" status: 200 len: 1370 microversion: 2.1 time: 0.174783 Mar 31 18:16:55.701868 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 207/395] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:55 2022] GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88 => generated 1370 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:55.749115 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-890c5048-ed1a-4dcd-b5b6-ff3edcc80eda tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dd6eaa597d4b61b3c7f3719217baa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7dee7188943ae84823848038e5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:55.758017 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-890c5048-ed1a-4dcd-b5b6-ff3edcc80eda tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] 10.222.0.58 "GET /compute/v2.1/servers/0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0" status: 200 len: 1314 microversion: 2.1 time: 0.171900 Mar 31 18:16:55.769795 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 189/396] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:55 2022] GET /compute/v2.1/servers/0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0 => generated 1314 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:16:56.724497 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-fb933549-679d-4bae-8b70-db20e76b4429 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:56.724497 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-fb933549-679d-4bae-8b70-db20e76b4429 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: a2498a53-f6d8-4236-8788-289622fc2c88] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:56.725491 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-fb933549-679d-4bae-8b70-db20e76b4429 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:56.725895 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-fb933549-679d-4bae-8b70-db20e76b4429 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:56.727520 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-fb933549-679d-4bae-8b70-db20e76b4429 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:56.728158 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-fb933549-679d-4bae-8b70-db20e76b4429 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:56.776306 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-a5fe2750-3db9-4206-b9d0-19d105da4347 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:56.776749 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-a5fe2750-3db9-4206-b9d0-19d105da4347 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:56.782703 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a5fe2750-3db9-4206-b9d0-19d105da4347 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:56.783147 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a5fe2750-3db9-4206-b9d0-19d105da4347 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:56.783906 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a5fe2750-3db9-4206-b9d0-19d105da4347 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:56.784500 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a5fe2750-3db9-4206-b9d0-19d105da4347 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:56.882928 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-fb933549-679d-4bae-8b70-db20e76b4429 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:56.892941 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-fb933549-679d-4bae-8b70-db20e76b4429 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88" status: 200 len: 1370 microversion: 2.1 time: 0.179323 Mar 31 18:16:56.893635 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 208/397] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:56 2022] GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88 => generated 1370 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:56.944553 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-a5fe2750-3db9-4206-b9d0-19d105da4347 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dd6eaa597d4b61b3c7f3719217baa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7dee7188943ae84823848038e5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:56.952644 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-a5fe2750-3db9-4206-b9d0-19d105da4347 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] 10.222.0.58 "GET /compute/v2.1/servers/0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0" status: 200 len: 1314 microversion: 2.1 time: 0.180893 Mar 31 18:16:56.953213 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 190/398] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:56 2022] GET /compute/v2.1/servers/0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:57.911510 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-b51ce067-7bd8-4b52-a585-fc234d2760ec tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:57.912349 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-b51ce067-7bd8-4b52-a585-fc234d2760ec tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: a2498a53-f6d8-4236-8788-289622fc2c88] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:57.919792 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b51ce067-7bd8-4b52-a585-fc234d2760ec tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:57.920412 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b51ce067-7bd8-4b52-a585-fc234d2760ec tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:57.921179 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b51ce067-7bd8-4b52-a585-fc234d2760ec tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:57.921605 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b51ce067-7bd8-4b52-a585-fc234d2760ec tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:57.969092 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-f0c1913d-494d-435e-98ee-53fb24c64390 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:57.969728 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-f0c1913d-494d-435e-98ee-53fb24c64390 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:57.975642 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-f0c1913d-494d-435e-98ee-53fb24c64390 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:57.976077 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-f0c1913d-494d-435e-98ee-53fb24c64390 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:57.976990 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-f0c1913d-494d-435e-98ee-53fb24c64390 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:57.977284 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-f0c1913d-494d-435e-98ee-53fb24c64390 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:58.092055 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-b51ce067-7bd8-4b52-a585-fc234d2760ec tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:58.107968 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-b51ce067-7bd8-4b52-a585-fc234d2760ec tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88" status: 200 len: 1370 microversion: 2.1 time: 0.200470 Mar 31 18:16:58.111179 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 209/399] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:57 2022] GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88 => generated 1370 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:58.167271 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-f0c1913d-494d-435e-98ee-53fb24c64390 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dd6eaa597d4b61b3c7f3719217baa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7dee7188943ae84823848038e5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:58.175925 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-f0c1913d-494d-435e-98ee-53fb24c64390 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] 10.222.0.58 "GET /compute/v2.1/servers/0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0" status: 200 len: 1314 microversion: 2.1 time: 0.210564 Mar 31 18:16:58.177218 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 191/400] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:57 2022] GET /compute/v2.1/servers/0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:16:59.128046 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-3f0e8f8d-c021-41fc-bacf-2967400902df tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:59.128654 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-3f0e8f8d-c021-41fc-bacf-2967400902df tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: a2498a53-f6d8-4236-8788-289622fc2c88] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:59.135197 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3f0e8f8d-c021-41fc-bacf-2967400902df tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:59.135643 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3f0e8f8d-c021-41fc-bacf-2967400902df tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:59.136404 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3f0e8f8d-c021-41fc-bacf-2967400902df tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:59.136833 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3f0e8f8d-c021-41fc-bacf-2967400902df tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:59.193191 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-b29e862b-d7c1-4b92-9163-6b6610c1e2aa tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:16:59.194433 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-b29e862b-d7c1-4b92-9163-6b6610c1e2aa tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:16:59.201189 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b29e862b-d7c1-4b92-9163-6b6610c1e2aa tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:59.201634 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b29e862b-d7c1-4b92-9163-6b6610c1e2aa tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:59.202407 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b29e862b-d7c1-4b92-9163-6b6610c1e2aa tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:59.202865 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b29e862b-d7c1-4b92-9163-6b6610c1e2aa tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:59.293016 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-3f0e8f8d-c021-41fc-bacf-2967400902df tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:59.302060 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-3f0e8f8d-c021-41fc-bacf-2967400902df tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88" status: 200 len: 1370 microversion: 2.1 time: 0.177762 Mar 31 18:16:59.304254 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 210/401] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:59 2022] GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88 => generated 1370 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:16:59.383769 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-b29e862b-d7c1-4b92-9163-6b6610c1e2aa tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dd6eaa597d4b61b3c7f3719217baa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7dee7188943ae84823848038e5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:16:59.392757 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-b29e862b-d7c1-4b92-9163-6b6610c1e2aa tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] 10.222.0.58 "GET /compute/v2.1/servers/0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0" status: 200 len: 1314 microversion: 2.1 time: 0.203517 Mar 31 18:16:59.393319 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 192/402] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:16:59 2022] GET /compute/v2.1/servers/0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0 => generated 1314 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:16:59.727459 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [req-ddf9f6a9-7303-496c-97a7-a79ef7a76fc8 req-238a3f22-2b1e-4203-a8a3-67f7b3aca6ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0", "name": "network-vif-plugged", "status": "completed", "tag": "86623eca-526d-4e62-a3a8-2d929a18df20"}]} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:16:59.735714 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-ddf9f6a9-7303-496c-97a7-a79ef7a76fc8 req-238a3f22-2b1e-4203-a8a3-67f7b3aca6ec service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:16:59.736153 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-ddf9f6a9-7303-496c-97a7-a79ef7a76fc8 req-238a3f22-2b1e-4203-a8a3-67f7b3aca6ec service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:16:59.747441 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.compute.server_external_events [req-ddf9f6a9-7303-496c-97a7-a79ef7a76fc8 req-238a3f22-2b1e-4203-a8a3-67f7b3aca6ec service nova] Creating event network-vif-plugged:86623eca-526d-4e62-a3a8-2d929a18df20 for instance 0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0 on hv-cinder-maste Mar 31 18:16:59.753121 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [req-ddf9f6a9-7303-496c-97a7-a79ef7a76fc8 req-238a3f22-2b1e-4203-a8a3-67f7b3aca6ec service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029440 Mar 31 18:16:59.754077 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 211/403] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:16:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:17:00.319940 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-bf5813ba-6ff5-4a47-a156-6c995ca111d8 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:17:00.321256 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-bf5813ba-6ff5-4a47-a156-6c995ca111d8 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: a2498a53-f6d8-4236-8788-289622fc2c88] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:17:00.327295 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-bf5813ba-6ff5-4a47-a156-6c995ca111d8 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:17:00.327737 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-bf5813ba-6ff5-4a47-a156-6c995ca111d8 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:17:00.328711 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-bf5813ba-6ff5-4a47-a156-6c995ca111d8 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:17:00.329143 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-bf5813ba-6ff5-4a47-a156-6c995ca111d8 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:17:00.412134 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-213abf6e-a497-4fd9-93b9-a822a0b2a1b1 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:17:00.412829 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-213abf6e-a497-4fd9-93b9-a822a0b2a1b1 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:17:00.419650 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-213abf6e-a497-4fd9-93b9-a822a0b2a1b1 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:17:00.420093 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-213abf6e-a497-4fd9-93b9-a822a0b2a1b1 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:17:00.420868 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-213abf6e-a497-4fd9-93b9-a822a0b2a1b1 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:17:00.421298 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-213abf6e-a497-4fd9-93b9-a822a0b2a1b1 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:17:00.473321 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-bf5813ba-6ff5-4a47-a156-6c995ca111d8 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:17:00.481100 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-bf5813ba-6ff5-4a47-a156-6c995ca111d8 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88" status: 200 len: 1370 microversion: 2.1 time: 0.164938 Mar 31 18:17:00.481766 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 193/404] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:17:00 2022] GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88 => generated 1370 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:17:00.565796 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-213abf6e-a497-4fd9-93b9-a822a0b2a1b1 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dd6eaa597d4b61b3c7f3719217baa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7dee7188943ae84823848038e5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:17:00.575255 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-213abf6e-a497-4fd9-93b9-a822a0b2a1b1 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] 10.222.0.58 "GET /compute/v2.1/servers/0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0" status: 200 len: 1314 microversion: 2.1 time: 0.167616 Mar 31 18:17:00.583243 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 212/405] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:17:00 2022] GET /compute/v2.1/servers/0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0 => generated 1314 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:17:01.500066 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-d3271c29-667e-4075-a428-8f1c6153aaae tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:17:01.500800 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-d3271c29-667e-4075-a428-8f1c6153aaae tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: a2498a53-f6d8-4236-8788-289622fc2c88] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:17:01.506503 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-d3271c29-667e-4075-a428-8f1c6153aaae tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:17:01.507042 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-d3271c29-667e-4075-a428-8f1c6153aaae tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:17:01.508325 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-d3271c29-667e-4075-a428-8f1c6153aaae tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:17:01.508760 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-d3271c29-667e-4075-a428-8f1c6153aaae tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:17:01.592931 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-37175169-b54e-4ab6-8ff5-4034dab4ceeb tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:17:01.593540 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-37175169-b54e-4ab6-8ff5-4034dab4ceeb tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:17:01.614499 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-37175169-b54e-4ab6-8ff5-4034dab4ceeb tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:17:01.615975 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-37175169-b54e-4ab6-8ff5-4034dab4ceeb tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:17:01.616769 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-37175169-b54e-4ab6-8ff5-4034dab4ceeb tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:17:01.623545 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-37175169-b54e-4ab6-8ff5-4034dab4ceeb tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:17:01.659758 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-d3271c29-667e-4075-a428-8f1c6153aaae tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:17:01.669038 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-d3271c29-667e-4075-a428-8f1c6153aaae tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88" status: 200 len: 1370 microversion: 2.1 time: 0.172952 Mar 31 18:17:01.669955 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 194/406] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:17:01 2022] GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88 => generated 1370 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:17:01.772789 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [req-d091d713-efc4-45ba-bef8-6c66a0380833 req-ecfad5e3-f54d-43a1-8823-4a50235443d5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2498a53-f6d8-4236-8788-289622fc2c88", "name": "network-vif-plugged", "status": "completed", "tag": "5510c46b-9407-41b3-b02d-dbe7f958b08c"}]} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:17:01.780711 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-d091d713-efc4-45ba-bef8-6c66a0380833 req-ecfad5e3-f54d-43a1-8823-4a50235443d5 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:17:01.781149 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-d091d713-efc4-45ba-bef8-6c66a0380833 req-ecfad5e3-f54d-43a1-8823-4a50235443d5 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:17:01.792678 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.compute.server_external_events [req-d091d713-efc4-45ba-bef8-6c66a0380833 req-ecfad5e3-f54d-43a1-8823-4a50235443d5 service nova] Creating event network-vif-plugged:5510c46b-9407-41b3-b02d-dbe7f958b08c for instance a2498a53-f6d8-4236-8788-289622fc2c88 on hv-cinder-maste Mar 31 18:17:01.793763 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-37175169-b54e-4ab6-8ff5-4034dab4ceeb tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dd6eaa597d4b61b3c7f3719217baa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7dee7188943ae84823848038e5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:17:01.798022 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [req-d091d713-efc4-45ba-bef8-6c66a0380833 req-ecfad5e3-f54d-43a1-8823-4a50235443d5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029075 Mar 31 18:17:01.798851 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 195/407] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 31 18:17:01.801673 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-37175169-b54e-4ab6-8ff5-4034dab4ceeb tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] 10.222.0.58 "GET /compute/v2.1/servers/0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0" status: 200 len: 1314 microversion: 2.1 time: 0.212781 Mar 31 18:17:01.808952 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 213/408] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:17:01 2022] GET /compute/v2.1/servers/0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0 => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:17:02.686914 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-d2928f45-1e2b-457d-af04-7f4d7d41eb1f tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:17:02.687596 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-d2928f45-1e2b-457d-af04-7f4d7d41eb1f tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: a2498a53-f6d8-4236-8788-289622fc2c88] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:17:02.693458 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-d2928f45-1e2b-457d-af04-7f4d7d41eb1f tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:17:02.693891 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-d2928f45-1e2b-457d-af04-7f4d7d41eb1f tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:17:02.694657 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-d2928f45-1e2b-457d-af04-7f4d7d41eb1f tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:17:02.695613 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-d2928f45-1e2b-457d-af04-7f4d7d41eb1f tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:17:02.819591 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-ff1d2256-dcb3-4370-b731-07cf61245cd7 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:17:02.820520 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-ff1d2256-dcb3-4370-b731-07cf61245cd7 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:17:02.826867 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-ff1d2256-dcb3-4370-b731-07cf61245cd7 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:17:02.827312 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-ff1d2256-dcb3-4370-b731-07cf61245cd7 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:17:02.828068 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-ff1d2256-dcb3-4370-b731-07cf61245cd7 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:17:02.828498 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-ff1d2256-dcb3-4370-b731-07cf61245cd7 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:17:02.828902 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-d2928f45-1e2b-457d-af04-7f4d7d41eb1f tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:17:02.836823 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-d2928f45-1e2b-457d-af04-7f4d7d41eb1f tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88" status: 200 len: 1370 microversion: 2.1 time: 0.154075 Mar 31 18:17:02.837384 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 196/409] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:17:02 2022] GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88 => generated 1370 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:17:02.964817 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-ff1d2256-dcb3-4370-b731-07cf61245cd7 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dd6eaa597d4b61b3c7f3719217baa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7dee7188943ae84823848038e5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:17:02.972887 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-ff1d2256-dcb3-4370-b731-07cf61245cd7 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] 10.222.0.58 "GET /compute/v2.1/servers/0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0" status: 200 len: 1498 microversion: 2.1 time: 0.156985 Mar 31 18:17:02.973872 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 214/410] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:17:02 2022] GET /compute/v2.1/servers/0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0 => generated 1498 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:17:03.854303 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-a81e2163-3872-4fb3-a7d7-c29e52cd7ebe tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:17:03.855785 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-a81e2163-3872-4fb3-a7d7-c29e52cd7ebe tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: a2498a53-f6d8-4236-8788-289622fc2c88] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:17:03.862040 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a81e2163-3872-4fb3-a7d7-c29e52cd7ebe tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:17:03.862491 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a81e2163-3872-4fb3-a7d7-c29e52cd7ebe tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:17:03.863283 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a81e2163-3872-4fb3-a7d7-c29e52cd7ebe tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:17:03.867603 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a81e2163-3872-4fb3-a7d7-c29e52cd7ebe tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:17:04.098196 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-a81e2163-3872-4fb3-a7d7-c29e52cd7ebe tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:17:04.107077 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-a81e2163-3872-4fb3-a7d7-c29e52cd7ebe tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88" status: 200 len: 1370 microversion: 2.1 time: 0.257311 Mar 31 18:17:04.108813 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 197/411] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:17:03 2022] GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88 => generated 1370 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:17:04.374288 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-481254a0-aca7-4334-95c6-2192ace5cbcc tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:17:04.374820 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-481254a0-aca7-4334-95c6-2192ace5cbcc tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:17:04.381054 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-481254a0-aca7-4334-95c6-2192ace5cbcc tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:17:04.381510 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-481254a0-aca7-4334-95c6-2192ace5cbcc tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:17:04.382312 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-481254a0-aca7-4334-95c6-2192ace5cbcc tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:17:04.382761 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-481254a0-aca7-4334-95c6-2192ace5cbcc tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:17:04.409449 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-481254a0-aca7-4334-95c6-2192ace5cbcc tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0] Going to try to terminate instance {{(pid=117538) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 31 18:17:04.941649 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-481254a0-aca7-4334-95c6-2192ace5cbcc tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] 10.222.0.58 "DELETE /compute/v2.1/servers/0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0" status: 204 len: 0 microversion: 2.1 time: 0.570857 Mar 31 18:17:04.942234 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 215/412] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Mar 31 18:17:04 2022] DELETE /compute/v2.1/servers/0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0 => generated 0 bytes in 572 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 31 18:17:04.951351 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-7d1fd098-a515-4ba6-a72e-3d11c2fb3c46 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:17:04.952127 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-7d1fd098-a515-4ba6-a72e-3d11c2fb3c46 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:17:04.957958 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-7d1fd098-a515-4ba6-a72e-3d11c2fb3c46 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:17:04.958492 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-7d1fd098-a515-4ba6-a72e-3d11c2fb3c46 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:17:04.959387 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-7d1fd098-a515-4ba6-a72e-3d11c2fb3c46 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:17:04.959933 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-7d1fd098-a515-4ba6-a72e-3d11c2fb3c46 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:17:05.124847 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-a372658c-0ec3-45e2-b8e3-c0095dec0a2c tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:17:05.125142 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-7d1fd098-a515-4ba6-a72e-3d11c2fb3c46 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dd6eaa597d4b61b3c7f3719217baa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7dee7188943ae84823848038e5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:17:05.129080 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-a372658c-0ec3-45e2-b8e3-c0095dec0a2c tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: a2498a53-f6d8-4236-8788-289622fc2c88] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:17:05.133990 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-7d1fd098-a515-4ba6-a72e-3d11c2fb3c46 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] 10.222.0.58 "GET /compute/v2.1/servers/0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0" status: 200 len: 1504 microversion: 2.1 time: 0.186419 Mar 31 18:17:05.134638 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 198/413] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:17:04 2022] GET /compute/v2.1/servers/0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0 => generated 1504 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:17:05.135799 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a372658c-0ec3-45e2-b8e3-c0095dec0a2c tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:17:05.136249 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a372658c-0ec3-45e2-b8e3-c0095dec0a2c tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:17:05.137017 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a372658c-0ec3-45e2-b8e3-c0095dec0a2c tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:17:05.137443 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a372658c-0ec3-45e2-b8e3-c0095dec0a2c tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:17:05.314415 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-a372658c-0ec3-45e2-b8e3-c0095dec0a2c tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:17:05.322161 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-a372658c-0ec3-45e2-b8e3-c0095dec0a2c tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88" status: 200 len: 1564 microversion: 2.1 time: 0.201595 Mar 31 18:17:05.322787 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 216/414] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:17:05 2022] GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88 => generated 1564 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:17:05.339120 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-5b1cc1f5-1a7e-4eb8-8dcc-347be6c979cd tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:17:05.339612 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-5b1cc1f5-1a7e-4eb8-8dcc-347be6c979cd tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: a2498a53-f6d8-4236-8788-289622fc2c88] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:17:05.346150 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-5b1cc1f5-1a7e-4eb8-8dcc-347be6c979cd tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:17:05.346502 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-5b1cc1f5-1a7e-4eb8-8dcc-347be6c979cd tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:17:05.347284 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-5b1cc1f5-1a7e-4eb8-8dcc-347be6c979cd tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:17:05.347757 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-5b1cc1f5-1a7e-4eb8-8dcc-347be6c979cd tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:17:05.477761 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-5b1cc1f5-1a7e-4eb8-8dcc-347be6c979cd tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.143197 Mar 31 18:17:05.478469 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 199/415] 10.222.0.58 () {58 vars in 1274 bytes} [Thu Mar 31 18:17:05 2022] GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88/os-interface => generated 284 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:17:06.152403 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-0e14c46b-3f29-4cdd-8afe-64f8b9d06117 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:17:06.152974 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-0e14c46b-3f29-4cdd-8afe-64f8b9d06117 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:17:06.159688 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-0e14c46b-3f29-4cdd-8afe-64f8b9d06117 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:17:06.160136 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-0e14c46b-3f29-4cdd-8afe-64f8b9d06117 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:17:06.160914 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-0e14c46b-3f29-4cdd-8afe-64f8b9d06117 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:17:06.161348 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-0e14c46b-3f29-4cdd-8afe-64f8b9d06117 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:17:06.571280 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-0e14c46b-3f29-4cdd-8afe-64f8b9d06117 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dd6eaa597d4b61b3c7f3719217baa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7dee7188943ae84823848038e5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:17:06.578453 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-0e14c46b-3f29-4cdd-8afe-64f8b9d06117 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] 10.222.0.58 "GET /compute/v2.1/servers/0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0" status: 200 len: 1504 microversion: 2.1 time: 0.430647 Mar 31 18:17:06.579044 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 217/416] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:17:06 2022] GET /compute/v2.1/servers/0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0 => generated 1504 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:17:06.907021 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [req-bbcb3fd7-e30e-4c3b-a98d-68d5b32b9388 req-4ec1c6d0-41a7-424a-95ab-48afdc1b4631 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2498a53-f6d8-4236-8788-289622fc2c88", "tag": "5510c46b-9407-41b3-b02d-dbe7f958b08c"}]} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:17:06.921097 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-bbcb3fd7-e30e-4c3b-a98d-68d5b32b9388 req-4ec1c6d0-41a7-424a-95ab-48afdc1b4631 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:17:06.926345 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-bbcb3fd7-e30e-4c3b-a98d-68d5b32b9388 req-4ec1c6d0-41a7-424a-95ab-48afdc1b4631 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:17:06.940231 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.compute.server_external_events [req-bbcb3fd7-e30e-4c3b-a98d-68d5b32b9388 req-4ec1c6d0-41a7-424a-95ab-48afdc1b4631 service nova] Creating event network-changed:5510c46b-9407-41b3-b02d-dbe7f958b08c for instance a2498a53-f6d8-4236-8788-289622fc2c88 on hv-cinder-maste Mar 31 18:17:06.966252 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [req-bbcb3fd7-e30e-4c3b-a98d-68d5b32b9388 req-4ec1c6d0-41a7-424a-95ab-48afdc1b4631 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044280 Mar 31 18:17:06.971017 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 200/417] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:17:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:17:07.596553 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-7b4e84dc-8bc0-4141-8a3d-bade9217f9f3 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:17:07.597442 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-7b4e84dc-8bc0-4141-8a3d-bade9217f9f3 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:17:07.604947 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-7b4e84dc-8bc0-4141-8a3d-bade9217f9f3 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:17:07.605725 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-7b4e84dc-8bc0-4141-8a3d-bade9217f9f3 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:17:07.606898 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-7b4e84dc-8bc0-4141-8a3d-bade9217f9f3 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:17:07.607493 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-7b4e84dc-8bc0-4141-8a3d-bade9217f9f3 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:17:07.993269 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-7b4e84dc-8bc0-4141-8a3d-bade9217f9f3 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dd6eaa597d4b61b3c7f3719217baa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7dee7188943ae84823848038e5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:17:08.001069 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-7b4e84dc-8bc0-4141-8a3d-bade9217f9f3 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] 10.222.0.58 "GET /compute/v2.1/servers/0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0" status: 200 len: 1504 microversion: 2.1 time: 0.408713 Mar 31 18:17:08.011478 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 218/418] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:17:07 2022] GET /compute/v2.1/servers/0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0 => generated 1504 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:17:08.982581 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [req-8a4ae2f1-dd18-4c76-a2ef-725f903a0f29 req-cc5bc545-9352-4136-abee-c55b398299f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0", "name": "network-vif-deleted", "tag": "86623eca-526d-4e62-a3a8-2d929a18df20"}]} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:17:08.992082 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-8a4ae2f1-dd18-4c76-a2ef-725f903a0f29 req-cc5bc545-9352-4136-abee-c55b398299f1 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:17:08.994216 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-8a4ae2f1-dd18-4c76-a2ef-725f903a0f29 req-cc5bc545-9352-4136-abee-c55b398299f1 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:17:09.003395 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.compute.server_external_events [req-8a4ae2f1-dd18-4c76-a2ef-725f903a0f29 req-cc5bc545-9352-4136-abee-c55b398299f1 service nova] Creating event network-vif-deleted:86623eca-526d-4e62-a3a8-2d929a18df20 for instance 0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0 on hv-cinder-maste Mar 31 18:17:09.009115 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [req-8a4ae2f1-dd18-4c76-a2ef-725f903a0f29 req-cc5bc545-9352-4136-abee-c55b398299f1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030883 Mar 31 18:17:09.009708 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 201/419] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:17:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:17:09.022879 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-97d0dbf7-af07-4454-a618-8b0a2aa1f86c tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:17:09.022879 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-97d0dbf7-af07-4454-a618-8b0a2aa1f86c tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:17:09.026033 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-97d0dbf7-af07-4454-a618-8b0a2aa1f86c tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:17:09.026475 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-97d0dbf7-af07-4454-a618-8b0a2aa1f86c tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:17:09.027264 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-97d0dbf7-af07-4454-a618-8b0a2aa1f86c tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:17:09.027697 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-97d0dbf7-af07-4454-a618-8b0a2aa1f86c tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:17:09.059973 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-97d0dbf7-af07-4454-a618-8b0a2aa1f86c tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:17:09.060415 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-97d0dbf7-af07-4454-a618-8b0a2aa1f86c tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:17:09.061042 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.objects.instance [None req-97d0dbf7-af07-4454-a618-8b0a2aa1f86c tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lazy-loading 'fault' on Instance uuid 0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0 {{(pid=117538) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 31 18:17:09.111079 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-97d0dbf7-af07-4454-a618-8b0a2aa1f86c tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '37dd6eaa597d4b61b3c7f3719217baa1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b2d7dee7188943ae84823848038e5357', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:17:09.120736 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-97d0dbf7-af07-4454-a618-8b0a2aa1f86c tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] 10.222.0.58 "GET /compute/v2.1/servers/0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0" status: 200 len: 1304 microversion: 2.1 time: 0.106075 Mar 31 18:17:09.121226 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 219/420] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:17:09 2022] GET /compute/v2.1/servers/0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0 => generated 1304 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:17:10.666293 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-3f757315-5771-4b55-86a2-b2bbaff79bb4 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:17:10.666293 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-3f757315-5771-4b55-86a2-b2bbaff79bb4 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] [instance: 0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:17:10.666293 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3f757315-5771-4b55-86a2-b2bbaff79bb4 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:17:10.666293 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3f757315-5771-4b55-86a2-b2bbaff79bb4 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:17:10.668582 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3f757315-5771-4b55-86a2-b2bbaff79bb4 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:17:10.668582 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3f757315-5771-4b55-86a2-b2bbaff79bb4 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:17:10.668582 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.wsgi [None req-3f757315-5771-4b55-86a2-b2bbaff79bb4 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] HTTP exception thrown: Instance 0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0 could not be found. Mar 31 18:17:10.668582 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-3f757315-5771-4b55-86a2-b2bbaff79bb4 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] Returning 404 to user: Instance 0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0 could not be found. {{(pid=117539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:17:10.668582 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-3f757315-5771-4b55-86a2-b2bbaff79bb4 tempest-VolumesActionsTest-1472785080 tempest-VolumesActionsTest-1472785080-project] 10.222.0.58 "GET /compute/v2.1/servers/0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0" status: 404 len: 111 microversion: 2.1 time: 0.028955 Mar 31 18:17:10.669318 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 202/421] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:17:10 2022] GET /compute/v2.1/servers/0d64f5fd-5a02-48f1-a20e-267b0d8b6fe0 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 31 18:17:11.910348 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 31 18:17:11.910990 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: Thu Mar 31 18:17:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 31 18:18:05.519565 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-7faae9dc-7a8b-452b-b8d9-49c777d4e7ac tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:18:05.520286 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-7faae9dc-7a8b-452b-b8d9-49c777d4e7ac tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:18:05.526810 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-7faae9dc-7a8b-452b-b8d9-49c777d4e7ac tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:05.534864 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-7faae9dc-7a8b-452b-b8d9-49c777d4e7ac tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:05.534864 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-7faae9dc-7a8b-452b-b8d9-49c777d4e7ac tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:05.534864 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-7faae9dc-7a8b-452b-b8d9-49c777d4e7ac tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:05.554947 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-7faae9dc-7a8b-452b-b8d9-49c777d4e7ac tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0/ips" status: 200 len: 151 microversion: 2.20 time: 0.040846 Mar 31 18:18:05.555632 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 220/422] 10.222.0.58 () {60 vars in 1288 bytes} [Thu Mar 31 18:18:05 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0/ips => generated 151 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 31 18:18:09.975040 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-7581769f-ab21-4e37-a7a1-e54076983dfb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:18:09.976795 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-7581769f-ab21-4e37-a7a1-e54076983dfb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:18:09.987500 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-7581769f-ab21-4e37-a7a1-e54076983dfb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:09.987500 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-7581769f-ab21-4e37-a7a1-e54076983dfb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:09.987796 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-7581769f-ab21-4e37-a7a1-e54076983dfb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:09.988397 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-7581769f-ab21-4e37-a7a1-e54076983dfb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:10.019226 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.objects.instance [None req-7581769f-ab21-4e37-a7a1-e54076983dfb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lazy-loading 'flavor' on Instance uuid 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 {{(pid=117539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 31 18:18:10.663567 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-7581769f-ab21-4e37-a7a1-e54076983dfb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "POST /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0/action" status: 202 len: 0 microversion: 2.20 time: 0.692595 Mar 31 18:18:10.664548 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 203/423] 10.222.0.58 () {62 vars in 1318 bytes} [Thu Mar 31 18:18:09 2022] POST /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0/action => generated 0 bytes in 695 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 31 18:18:10.672843 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-c4801fbd-2051-4aba-b52d-73ee5493863e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:18:10.674033 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-c4801fbd-2051-4aba-b52d-73ee5493863e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:18:10.680851 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c4801fbd-2051-4aba-b52d-73ee5493863e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:10.681345 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c4801fbd-2051-4aba-b52d-73ee5493863e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:10.682306 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c4801fbd-2051-4aba-b52d-73ee5493863e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:10.682763 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c4801fbd-2051-4aba-b52d-73ee5493863e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:11.031485 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-c4801fbd-2051-4aba-b52d-73ee5493863e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:11.044659 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-c4801fbd-2051-4aba-b52d-73ee5493863e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:11.048081 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-c4801fbd-2051-4aba-b52d-73ee5493863e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:11.051049 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-c4801fbd-2051-4aba-b52d-73ee5493863e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1724 microversion: 2.20 time: 0.381889 Mar 31 18:18:11.052145 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 221/424] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:18:10 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1724 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:18:12.070829 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-245a89be-6af8-4322-bf4f-6c8da1c9d86a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:18:12.071669 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-245a89be-6af8-4322-bf4f-6c8da1c9d86a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:18:12.078228 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-245a89be-6af8-4322-bf4f-6c8da1c9d86a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:12.079079 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-245a89be-6af8-4322-bf4f-6c8da1c9d86a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:12.079874 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-245a89be-6af8-4322-bf4f-6c8da1c9d86a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:12.080542 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-245a89be-6af8-4322-bf4f-6c8da1c9d86a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:12.238852 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-245a89be-6af8-4322-bf4f-6c8da1c9d86a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:12.247516 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-245a89be-6af8-4322-bf4f-6c8da1c9d86a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:12.249304 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-245a89be-6af8-4322-bf4f-6c8da1c9d86a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:12.251080 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-245a89be-6af8-4322-bf4f-6c8da1c9d86a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1724 microversion: 2.20 time: 0.184387 Mar 31 18:18:12.251743 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 204/425] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:18:12 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1724 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:18:13.273618 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-d5edb9da-a975-48ec-a0c1-e2772743f9ce tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:18:13.274239 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-d5edb9da-a975-48ec-a0c1-e2772743f9ce tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:18:13.289141 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-d5edb9da-a975-48ec-a0c1-e2772743f9ce tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:13.289740 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-d5edb9da-a975-48ec-a0c1-e2772743f9ce tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:13.291175 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-d5edb9da-a975-48ec-a0c1-e2772743f9ce tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:13.291629 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-d5edb9da-a975-48ec-a0c1-e2772743f9ce tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:13.506361 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-d5edb9da-a975-48ec-a0c1-e2772743f9ce tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:13.522760 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-d5edb9da-a975-48ec-a0c1-e2772743f9ce tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:13.527000 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-d5edb9da-a975-48ec-a0c1-e2772743f9ce tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:13.528612 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-d5edb9da-a975-48ec-a0c1-e2772743f9ce tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1724 microversion: 2.20 time: 0.258968 Mar 31 18:18:13.541990 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 222/426] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:18:13 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1724 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:18:14.548520 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-9dccee3a-7b97-42d2-b255-fb183bb18d05 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:18:14.549891 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-9dccee3a-7b97-42d2-b255-fb183bb18d05 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:18:14.557553 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9dccee3a-7b97-42d2-b255-fb183bb18d05 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:14.557553 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9dccee3a-7b97-42d2-b255-fb183bb18d05 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:14.558554 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9dccee3a-7b97-42d2-b255-fb183bb18d05 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:14.559189 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9dccee3a-7b97-42d2-b255-fb183bb18d05 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:14.799164 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-9dccee3a-7b97-42d2-b255-fb183bb18d05 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:14.814336 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-9dccee3a-7b97-42d2-b255-fb183bb18d05 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:14.815971 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-9dccee3a-7b97-42d2-b255-fb183bb18d05 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:14.817372 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-9dccee3a-7b97-42d2-b255-fb183bb18d05 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1724 microversion: 2.20 time: 0.272942 Mar 31 18:18:14.823153 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 205/427] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:18:14 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1724 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 31 18:18:15.385144 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-66c56330-f25c-4d6e-a68b-f595a181806f tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Action: 'create', calling method: .version_select at 0x7fa4d433fee0>, body: {"keypair": {"name": "tempest-TestShelveInstance-1385990206"}} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:18:15.399375 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.quota [None req-66c56330-f25c-4d6e-a68b-f595a181806f tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Getting quotas for project 10c09876736547b59f4bb56fa5740f5f. Resources: {'key_pairs'} {{(pid=117538) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 31 18:18:15.403436 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.quota [None req-66c56330-f25c-4d6e-a68b-f595a181806f tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Getting quotas for user 6f1d5c7f14e2491aa217a7d2939fe962 and project 10c09876736547b59f4bb56fa5740f5f. Resources: {'key_pairs'} {{(pid=117538) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 31 18:18:15.830987 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.quota [None req-66c56330-f25c-4d6e-a68b-f595a181806f tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Getting quotas for project 10c09876736547b59f4bb56fa5740f5f. Resources: {'key_pairs'} {{(pid=117538) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 31 18:18:15.834916 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.quota [None req-66c56330-f25c-4d6e-a68b-f595a181806f tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Getting quotas for user 6f1d5c7f14e2491aa217a7d2939fe962 and project 10c09876736547b59f4bb56fa5740f5f. Resources: {'key_pairs'} {{(pid=117538) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 31 18:18:15.836281 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-4f699333-b8bd-4ca4-8854-d41a1460e082 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:18:15.836870 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-4f699333-b8bd-4ca4-8854-d41a1460e082 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:18:15.843276 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-4f699333-b8bd-4ca4-8854-d41a1460e082 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:15.843667 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-4f699333-b8bd-4ca4-8854-d41a1460e082 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:15.846385 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-4f699333-b8bd-4ca4-8854-d41a1460e082 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:15.846992 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-4f699333-b8bd-4ca4-8854-d41a1460e082 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:15.854666 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-66c56330-f25c-4d6e-a68b-f595a181806f tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 2316 microversion: 2.1 time: 0.670013 Mar 31 18:18:15.856173 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 223/428] 10.222.0.58 () {60 vars in 1157 bytes} [Thu Mar 31 18:18:15 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 672 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:18:16.044921 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-4f699333-b8bd-4ca4-8854-d41a1460e082 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:16.053792 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-4f699333-b8bd-4ca4-8854-d41a1460e082 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:16.055392 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-4f699333-b8bd-4ca4-8854-d41a1460e082 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:16.057221 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-4f699333-b8bd-4ca4-8854-d41a1460e082 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1724 microversion: 2.20 time: 0.224715 Mar 31 18:18:16.058221 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 206/429] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:18:15 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1724 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:18:17.079658 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-5788b461-960e-4d78-98dc-25ddd867f2cb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:18:17.080261 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-5788b461-960e-4d78-98dc-25ddd867f2cb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:18:17.086762 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-5788b461-960e-4d78-98dc-25ddd867f2cb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:17.087209 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-5788b461-960e-4d78-98dc-25ddd867f2cb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:17.087969 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-5788b461-960e-4d78-98dc-25ddd867f2cb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:17.088398 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-5788b461-960e-4d78-98dc-25ddd867f2cb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:17.230495 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-5788b461-960e-4d78-98dc-25ddd867f2cb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:17.240586 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-5788b461-960e-4d78-98dc-25ddd867f2cb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:17.242446 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-5788b461-960e-4d78-98dc-25ddd867f2cb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:17.243870 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-5788b461-960e-4d78-98dc-25ddd867f2cb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1724 microversion: 2.20 time: 0.169132 Mar 31 18:18:17.244624 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 224/430] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:18:17 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:18:18.262344 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-c33c489c-b799-4753-94ad-db3236ede5b1 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:18:18.263033 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-c33c489c-b799-4753-94ad-db3236ede5b1 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:18:18.269634 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c33c489c-b799-4753-94ad-db3236ede5b1 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:18.270057 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c33c489c-b799-4753-94ad-db3236ede5b1 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:18.270992 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c33c489c-b799-4753-94ad-db3236ede5b1 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:18.271499 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c33c489c-b799-4753-94ad-db3236ede5b1 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:18.438838 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-c33c489c-b799-4753-94ad-db3236ede5b1 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:18.449534 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-c33c489c-b799-4753-94ad-db3236ede5b1 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:18.451071 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-c33c489c-b799-4753-94ad-db3236ede5b1 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:18.452246 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-c33c489c-b799-4753-94ad-db3236ede5b1 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1724 microversion: 2.20 time: 0.193906 Mar 31 18:18:18.452797 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 207/431] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:18:18 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1724 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:18:19.471099 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-9ee2a904-9e53-4a38-b728-9b46cde0aa22 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:18:19.471704 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-9ee2a904-9e53-4a38-b728-9b46cde0aa22 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:18:19.477894 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9ee2a904-9e53-4a38-b728-9b46cde0aa22 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:19.478337 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9ee2a904-9e53-4a38-b728-9b46cde0aa22 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:19.479129 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9ee2a904-9e53-4a38-b728-9b46cde0aa22 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:19.479557 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9ee2a904-9e53-4a38-b728-9b46cde0aa22 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:19.614893 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-9ee2a904-9e53-4a38-b728-9b46cde0aa22 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:19.622511 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-9ee2a904-9e53-4a38-b728-9b46cde0aa22 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:19.623998 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-9ee2a904-9e53-4a38-b728-9b46cde0aa22 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:19.625478 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-9ee2a904-9e53-4a38-b728-9b46cde0aa22 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1724 microversion: 2.20 time: 0.158058 Mar 31 18:18:19.626308 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 225/432] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:18:19 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:18:20.649416 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-66a2d740-f09d-4bcd-9df1-050f68027a13 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:18:20.650006 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-66a2d740-f09d-4bcd-9df1-050f68027a13 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:18:20.655906 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-66a2d740-f09d-4bcd-9df1-050f68027a13 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:20.656439 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-66a2d740-f09d-4bcd-9df1-050f68027a13 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:20.657182 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-66a2d740-f09d-4bcd-9df1-050f68027a13 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:20.658769 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-66a2d740-f09d-4bcd-9df1-050f68027a13 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:20.791937 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-66a2d740-f09d-4bcd-9df1-050f68027a13 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:20.800152 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-66a2d740-f09d-4bcd-9df1-050f68027a13 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:20.801647 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-66a2d740-f09d-4bcd-9df1-050f68027a13 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:20.802815 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-66a2d740-f09d-4bcd-9df1-050f68027a13 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1724 microversion: 2.20 time: 0.157263 Mar 31 18:18:20.803369 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 208/433] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:18:20 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:18:21.821099 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-314a79e6-46f2-4384-a605-b599cc394522 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:18:21.821711 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-314a79e6-46f2-4384-a605-b599cc394522 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:18:21.828529 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-314a79e6-46f2-4384-a605-b599cc394522 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:21.828979 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-314a79e6-46f2-4384-a605-b599cc394522 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:21.829745 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-314a79e6-46f2-4384-a605-b599cc394522 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:21.830178 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-314a79e6-46f2-4384-a605-b599cc394522 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:21.961746 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-314a79e6-46f2-4384-a605-b599cc394522 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:21.969555 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-314a79e6-46f2-4384-a605-b599cc394522 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:21.971077 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-314a79e6-46f2-4384-a605-b599cc394522 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:21.972234 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-314a79e6-46f2-4384-a605-b599cc394522 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1724 microversion: 2.20 time: 0.154974 Mar 31 18:18:21.972781 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 226/434] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:18:21 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:18:23.137223 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-73011117-4ae6-4a8d-a2e4-a9842e666e98 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:18:23.137223 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-73011117-4ae6-4a8d-a2e4-a9842e666e98 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:18:23.137223 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-73011117-4ae6-4a8d-a2e4-a9842e666e98 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:23.137223 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-73011117-4ae6-4a8d-a2e4-a9842e666e98 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:23.139020 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-73011117-4ae6-4a8d-a2e4-a9842e666e98 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:23.139020 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-73011117-4ae6-4a8d-a2e4-a9842e666e98 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:23.161193 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-73011117-4ae6-4a8d-a2e4-a9842e666e98 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:23.170998 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-73011117-4ae6-4a8d-a2e4-a9842e666e98 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:23.173262 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-73011117-4ae6-4a8d-a2e4-a9842e666e98 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:23.182354 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-73011117-4ae6-4a8d-a2e4-a9842e666e98 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1724 microversion: 2.20 time: 0.187674 Mar 31 18:18:23.182354 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 209/435] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:18:22 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1724 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:18:24.201797 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-cfced90b-ebf0-470d-92b3-e710611a5cdf tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:18:24.201797 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-cfced90b-ebf0-470d-92b3-e710611a5cdf tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:18:24.217661 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-cfced90b-ebf0-470d-92b3-e710611a5cdf tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:24.218147 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-cfced90b-ebf0-470d-92b3-e710611a5cdf tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:24.219137 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-cfced90b-ebf0-470d-92b3-e710611a5cdf tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:24.219567 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-cfced90b-ebf0-470d-92b3-e710611a5cdf tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:24.365861 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-cfced90b-ebf0-470d-92b3-e710611a5cdf tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:24.373594 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-cfced90b-ebf0-470d-92b3-e710611a5cdf tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:24.375834 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-cfced90b-ebf0-470d-92b3-e710611a5cdf tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:24.377025 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-cfced90b-ebf0-470d-92b3-e710611a5cdf tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1724 microversion: 2.20 time: 0.180343 Mar 31 18:18:24.377590 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 227/436] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:18:24 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:18:25.397082 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-0695dfb4-b1fe-4a85-bd0c-c783100b646f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:18:25.397721 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-0695dfb4-b1fe-4a85-bd0c-c783100b646f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:18:25.403778 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0695dfb4-b1fe-4a85-bd0c-c783100b646f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:25.407357 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0695dfb4-b1fe-4a85-bd0c-c783100b646f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:25.407357 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0695dfb4-b1fe-4a85-bd0c-c783100b646f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:25.407357 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0695dfb4-b1fe-4a85-bd0c-c783100b646f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:25.560005 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-0695dfb4-b1fe-4a85-bd0c-c783100b646f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:25.568362 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-0695dfb4-b1fe-4a85-bd0c-c783100b646f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:25.569854 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-0695dfb4-b1fe-4a85-bd0c-c783100b646f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:25.571025 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-0695dfb4-b1fe-4a85-bd0c-c783100b646f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1724 microversion: 2.20 time: 0.177935 Mar 31 18:18:25.571584 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 210/437] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:18:25 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:18:26.589436 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-491d6f2f-dc0f-446a-94d4-d4c79d3264f8 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:18:26.590038 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-491d6f2f-dc0f-446a-94d4-d4c79d3264f8 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:18:26.597429 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-491d6f2f-dc0f-446a-94d4-d4c79d3264f8 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:26.597901 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-491d6f2f-dc0f-446a-94d4-d4c79d3264f8 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:26.598729 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-491d6f2f-dc0f-446a-94d4-d4c79d3264f8 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:26.599183 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-491d6f2f-dc0f-446a-94d4-d4c79d3264f8 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:26.731883 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-491d6f2f-dc0f-446a-94d4-d4c79d3264f8 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:26.738680 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-491d6f2f-dc0f-446a-94d4-d4c79d3264f8 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:26.740153 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-491d6f2f-dc0f-446a-94d4-d4c79d3264f8 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:26.741291 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-491d6f2f-dc0f-446a-94d4-d4c79d3264f8 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1724 microversion: 2.20 time: 0.155808 Mar 31 18:18:26.741832 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 228/438] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:18:26 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:18:27.759937 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-50e0b7a2-2f38-4782-b020-b0cfb5799eb2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:18:27.760566 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-50e0b7a2-2f38-4782-b020-b0cfb5799eb2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:18:27.766931 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-50e0b7a2-2f38-4782-b020-b0cfb5799eb2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:27.767372 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-50e0b7a2-2f38-4782-b020-b0cfb5799eb2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:27.768140 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-50e0b7a2-2f38-4782-b020-b0cfb5799eb2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:27.768557 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-50e0b7a2-2f38-4782-b020-b0cfb5799eb2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:27.901966 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-50e0b7a2-2f38-4782-b020-b0cfb5799eb2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:27.910535 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-50e0b7a2-2f38-4782-b020-b0cfb5799eb2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:27.912102 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-50e0b7a2-2f38-4782-b020-b0cfb5799eb2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:27.913287 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-50e0b7a2-2f38-4782-b020-b0cfb5799eb2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1745 microversion: 2.20 time: 0.157346 Mar 31 18:18:27.913848 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 211/439] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:18:27 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:18:28.933636 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-088d857c-c982-4685-8cf4-15efaab6415d tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:18:28.934155 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-088d857c-c982-4685-8cf4-15efaab6415d tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:18:28.939988 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-088d857c-c982-4685-8cf4-15efaab6415d tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:28.940426 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-088d857c-c982-4685-8cf4-15efaab6415d tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:28.941182 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-088d857c-c982-4685-8cf4-15efaab6415d tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:28.941606 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-088d857c-c982-4685-8cf4-15efaab6415d tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:29.076270 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-088d857c-c982-4685-8cf4-15efaab6415d tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:29.084316 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-088d857c-c982-4685-8cf4-15efaab6415d tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:29.087863 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-088d857c-c982-4685-8cf4-15efaab6415d tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:29.089259 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-088d857c-c982-4685-8cf4-15efaab6415d tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1745 microversion: 2.20 time: 0.159505 Mar 31 18:18:29.090813 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 229/440] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:18:28 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:18:30.109698 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-8b4746ac-1b68-47a8-af0c-d2f6f53c8efb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:18:30.111042 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-8b4746ac-1b68-47a8-af0c-d2f6f53c8efb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:18:30.117749 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-8b4746ac-1b68-47a8-af0c-d2f6f53c8efb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:30.118596 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-8b4746ac-1b68-47a8-af0c-d2f6f53c8efb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:30.120104 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-8b4746ac-1b68-47a8-af0c-d2f6f53c8efb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:30.120716 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-8b4746ac-1b68-47a8-af0c-d2f6f53c8efb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:30.341284 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-8b4746ac-1b68-47a8-af0c-d2f6f53c8efb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:30.349729 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-8b4746ac-1b68-47a8-af0c-d2f6f53c8efb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:30.351263 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-8b4746ac-1b68-47a8-af0c-d2f6f53c8efb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:30.352394 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-8b4746ac-1b68-47a8-af0c-d2f6f53c8efb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1745 microversion: 2.20 time: 0.247623 Mar 31 18:18:30.352937 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 212/441] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:18:30 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1745 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:18:31.370563 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-d7d95d09-a4d8-4dcc-ba5f-94f6ab4612e8 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:18:31.371245 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-d7d95d09-a4d8-4dcc-ba5f-94f6ab4612e8 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:18:31.377626 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-d7d95d09-a4d8-4dcc-ba5f-94f6ab4612e8 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:31.378130 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-d7d95d09-a4d8-4dcc-ba5f-94f6ab4612e8 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:31.379022 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-d7d95d09-a4d8-4dcc-ba5f-94f6ab4612e8 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:31.379450 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-d7d95d09-a4d8-4dcc-ba5f-94f6ab4612e8 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:31.523248 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-d7d95d09-a4d8-4dcc-ba5f-94f6ab4612e8 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:31.535144 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-d7d95d09-a4d8-4dcc-ba5f-94f6ab4612e8 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:31.536911 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-d7d95d09-a4d8-4dcc-ba5f-94f6ab4612e8 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:31.538156 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-d7d95d09-a4d8-4dcc-ba5f-94f6ab4612e8 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1745 microversion: 2.20 time: 0.171494 Mar 31 18:18:31.538880 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 230/442] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:18:31 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1745 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 31 18:18:31.738843 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [req-c1882e65-554d-4ecb-91a2-f30c1fe5c3e5 req-f9ee6c57-d071-4bc1-8a7c-8f377c739adf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0", "name": "network-vif-plugged", "status": "completed", "tag": "3bfd294a-f954-4562-8fbf-0cd104ab3bee"}]} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:18:31.754376 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-c1882e65-554d-4ecb-91a2-f30c1fe5c3e5 req-f9ee6c57-d071-4bc1-8a7c-8f377c739adf service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:31.754868 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-c1882e65-554d-4ecb-91a2-f30c1fe5c3e5 req-f9ee6c57-d071-4bc1-8a7c-8f377c739adf service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:31.767801 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.compute.server_external_events [req-c1882e65-554d-4ecb-91a2-f30c1fe5c3e5 req-f9ee6c57-d071-4bc1-8a7c-8f377c739adf service nova] Creating event network-vif-plugged:3bfd294a-f954-4562-8fbf-0cd104ab3bee for instance 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 on hv-cinder-maste Mar 31 18:18:31.772901 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [req-c1882e65-554d-4ecb-91a2-f30c1fe5c3e5 req-f9ee6c57-d071-4bc1-8a7c-8f377c739adf service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038331 Mar 31 18:18:31.773493 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 213/443] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:18:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:18:32.556961 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-31043c87-08c6-43f9-8d10-d19bf189ae3f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:18:32.558183 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-31043c87-08c6-43f9-8d10-d19bf189ae3f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:18:32.564702 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-31043c87-08c6-43f9-8d10-d19bf189ae3f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:32.565144 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-31043c87-08c6-43f9-8d10-d19bf189ae3f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:32.565903 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-31043c87-08c6-43f9-8d10-d19bf189ae3f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:32.566331 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-31043c87-08c6-43f9-8d10-d19bf189ae3f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:32.703579 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-31043c87-08c6-43f9-8d10-d19bf189ae3f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:32.711179 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-31043c87-08c6-43f9-8d10-d19bf189ae3f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:32.712666 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-31043c87-08c6-43f9-8d10-d19bf189ae3f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:32.713847 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-31043c87-08c6-43f9-8d10-d19bf189ae3f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1745 microversion: 2.20 time: 0.160763 Mar 31 18:18:32.714399 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 231/444] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:18:32 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:18:33.737511 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-dc1c46ff-fa6a-4fd8-871b-6389071dd8d0 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:18:33.738216 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-dc1c46ff-fa6a-4fd8-871b-6389071dd8d0 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:18:33.744299 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-dc1c46ff-fa6a-4fd8-871b-6389071dd8d0 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:33.744735 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-dc1c46ff-fa6a-4fd8-871b-6389071dd8d0 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:33.745589 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-dc1c46ff-fa6a-4fd8-871b-6389071dd8d0 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:33.746011 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-dc1c46ff-fa6a-4fd8-871b-6389071dd8d0 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:33.892146 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-dc1c46ff-fa6a-4fd8-871b-6389071dd8d0 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:33.900021 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-dc1c46ff-fa6a-4fd8-871b-6389071dd8d0 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:33.901731 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-dc1c46ff-fa6a-4fd8-871b-6389071dd8d0 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:33.902686 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-dc1c46ff-fa6a-4fd8-871b-6389071dd8d0 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1745 microversion: 2.20 time: 0.171524 Mar 31 18:18:33.903244 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 214/445] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:18:33 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1745 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 31 18:18:34.921325 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-4b32b3d8-e1b6-4632-95b3-39513684b2c9 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:18:34.922232 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-4b32b3d8-e1b6-4632-95b3-39513684b2c9 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:18:34.931654 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4b32b3d8-e1b6-4632-95b3-39513684b2c9 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:34.933005 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4b32b3d8-e1b6-4632-95b3-39513684b2c9 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:34.933005 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4b32b3d8-e1b6-4632-95b3-39513684b2c9 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:34.933363 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4b32b3d8-e1b6-4632-95b3-39513684b2c9 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:35.078829 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-4b32b3d8-e1b6-4632-95b3-39513684b2c9 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:35.086489 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-4b32b3d8-e1b6-4632-95b3-39513684b2c9 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:35.088006 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-4b32b3d8-e1b6-4632-95b3-39513684b2c9 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:35.089136 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-4b32b3d8-e1b6-4632-95b3-39513684b2c9 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1745 microversion: 2.20 time: 0.171818 Mar 31 18:18:35.089708 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 232/446] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:18:34 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1745 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:18:36.108808 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-a972f567-d648-4e48-915a-323d821f0264 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:18:36.109530 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-a972f567-d648-4e48-915a-323d821f0264 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:18:36.115447 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a972f567-d648-4e48-915a-323d821f0264 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:36.115944 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a972f567-d648-4e48-915a-323d821f0264 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:36.122899 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a972f567-d648-4e48-915a-323d821f0264 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:36.122899 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a972f567-d648-4e48-915a-323d821f0264 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:36.254996 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-a972f567-d648-4e48-915a-323d821f0264 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:36.262677 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-a972f567-d648-4e48-915a-323d821f0264 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:36.265035 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-a972f567-d648-4e48-915a-323d821f0264 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:36.266160 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-a972f567-d648-4e48-915a-323d821f0264 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1740 microversion: 2.20 time: 0.161882 Mar 31 18:18:36.266738 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 215/447] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:18:36 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1740 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:18:37.285602 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-aed08e46-b520-4045-8ecd-8448c4ff3d91 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:18:37.286201 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-aed08e46-b520-4045-8ecd-8448c4ff3d91 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:18:37.292723 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-aed08e46-b520-4045-8ecd-8448c4ff3d91 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:37.293165 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-aed08e46-b520-4045-8ecd-8448c4ff3d91 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:37.293922 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-aed08e46-b520-4045-8ecd-8448c4ff3d91 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:37.294380 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-aed08e46-b520-4045-8ecd-8448c4ff3d91 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:37.649479 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-aed08e46-b520-4045-8ecd-8448c4ff3d91 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:37.657683 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-aed08e46-b520-4045-8ecd-8448c4ff3d91 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:37.659203 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-aed08e46-b520-4045-8ecd-8448c4ff3d91 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:37.660332 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-aed08e46-b520-4045-8ecd-8448c4ff3d91 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1740 microversion: 2.20 time: 0.378614 Mar 31 18:18:37.660887 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 233/448] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:18:37 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1740 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:18:38.679666 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-bc879e61-722f-4473-b184-76c3030a51de tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:18:38.680265 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-bc879e61-722f-4473-b184-76c3030a51de tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:18:38.686734 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-bc879e61-722f-4473-b184-76c3030a51de tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:38.687175 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-bc879e61-722f-4473-b184-76c3030a51de tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:38.687917 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-bc879e61-722f-4473-b184-76c3030a51de tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:38.688342 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-bc879e61-722f-4473-b184-76c3030a51de tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:38.818845 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-bc879e61-722f-4473-b184-76c3030a51de tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:38.826405 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-bc879e61-722f-4473-b184-76c3030a51de tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:38.828014 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-bc879e61-722f-4473-b184-76c3030a51de tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:38.829132 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-bc879e61-722f-4473-b184-76c3030a51de tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1740 microversion: 2.20 time: 0.153663 Mar 31 18:18:38.829681 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 216/449] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:18:38 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1740 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:18:39.847898 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-4f617011-63e9-4536-9998-1723787a5638 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:18:39.848496 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-4f617011-63e9-4536-9998-1723787a5638 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:18:39.854677 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4f617011-63e9-4536-9998-1723787a5638 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:39.855114 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4f617011-63e9-4536-9998-1723787a5638 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:39.855858 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4f617011-63e9-4536-9998-1723787a5638 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:39.856283 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4f617011-63e9-4536-9998-1723787a5638 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:39.988069 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-4f617011-63e9-4536-9998-1723787a5638 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:39.995616 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-4f617011-63e9-4536-9998-1723787a5638 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:39.997092 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-4f617011-63e9-4536-9998-1723787a5638 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:39.999079 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-4f617011-63e9-4536-9998-1723787a5638 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1740 microversion: 2.20 time: 0.154283 Mar 31 18:18:39.999635 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 234/450] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:18:39 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1740 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 31 18:18:41.017694 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-ccde32a5-1ae9-4b2f-8d5f-804e3b8e9aab tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:18:41.018299 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-ccde32a5-1ae9-4b2f-8d5f-804e3b8e9aab tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:18:41.024116 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ccde32a5-1ae9-4b2f-8d5f-804e3b8e9aab tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:41.024551 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ccde32a5-1ae9-4b2f-8d5f-804e3b8e9aab tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:41.025296 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ccde32a5-1ae9-4b2f-8d5f-804e3b8e9aab tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:41.025717 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ccde32a5-1ae9-4b2f-8d5f-804e3b8e9aab tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:41.310360 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-ccde32a5-1ae9-4b2f-8d5f-804e3b8e9aab tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:41.318498 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-ccde32a5-1ae9-4b2f-8d5f-804e3b8e9aab tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:41.320018 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-ccde32a5-1ae9-4b2f-8d5f-804e3b8e9aab tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:41.321163 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-ccde32a5-1ae9-4b2f-8d5f-804e3b8e9aab tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1740 microversion: 2.20 time: 0.307863 Mar 31 18:18:41.321712 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 217/451] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:18:41 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1740 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:18:42.339549 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-8ed746a0-2377-412c-b738-e11bd5748387 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:18:42.340144 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-8ed746a0-2377-412c-b738-e11bd5748387 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:18:42.346937 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8ed746a0-2377-412c-b738-e11bd5748387 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:42.347377 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8ed746a0-2377-412c-b738-e11bd5748387 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:42.348127 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8ed746a0-2377-412c-b738-e11bd5748387 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:42.348550 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8ed746a0-2377-412c-b738-e11bd5748387 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:42.534534 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-8ed746a0-2377-412c-b738-e11bd5748387 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:42.542439 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-8ed746a0-2377-412c-b738-e11bd5748387 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:42.543994 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-8ed746a0-2377-412c-b738-e11bd5748387 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:42.545202 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-8ed746a0-2377-412c-b738-e11bd5748387 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1740 microversion: 2.20 time: 0.209521 Mar 31 18:18:42.545752 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 235/452] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:18:42 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1740 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:18:43.562838 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-f9b64b21-c20b-4063-8249-60f06b58424b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:18:43.563444 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-f9b64b21-c20b-4063-8249-60f06b58424b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:18:43.569274 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-f9b64b21-c20b-4063-8249-60f06b58424b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:43.569719 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-f9b64b21-c20b-4063-8249-60f06b58424b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:43.570476 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-f9b64b21-c20b-4063-8249-60f06b58424b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:43.570933 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-f9b64b21-c20b-4063-8249-60f06b58424b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:43.725281 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-f9b64b21-c20b-4063-8249-60f06b58424b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:43.734405 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-f9b64b21-c20b-4063-8249-60f06b58424b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:43.737188 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-f9b64b21-c20b-4063-8249-60f06b58424b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:43.739195 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-f9b64b21-c20b-4063-8249-60f06b58424b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1740 microversion: 2.20 time: 0.179936 Mar 31 18:18:43.740105 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 218/453] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:18:43 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1740 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:18:44.778555 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-58e66a57-fc33-4fa7-844c-c8ff44cf289b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:18:44.780689 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-58e66a57-fc33-4fa7-844c-c8ff44cf289b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:18:44.787841 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-58e66a57-fc33-4fa7-844c-c8ff44cf289b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:44.788485 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-58e66a57-fc33-4fa7-844c-c8ff44cf289b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:44.789435 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-58e66a57-fc33-4fa7-844c-c8ff44cf289b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:44.790037 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-58e66a57-fc33-4fa7-844c-c8ff44cf289b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:44.939483 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-58e66a57-fc33-4fa7-844c-c8ff44cf289b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:44.948649 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-58e66a57-fc33-4fa7-844c-c8ff44cf289b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:44.950409 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-58e66a57-fc33-4fa7-844c-c8ff44cf289b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:44.952852 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-58e66a57-fc33-4fa7-844c-c8ff44cf289b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1740 microversion: 2.20 time: 0.188118 Mar 31 18:18:44.953587 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 236/454] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:18:44 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1740 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:18:45.974196 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-dd24226c-7b2b-492a-af8b-932fc06ac26c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:18:45.974936 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-dd24226c-7b2b-492a-af8b-932fc06ac26c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:18:45.981106 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-dd24226c-7b2b-492a-af8b-932fc06ac26c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:45.981824 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-dd24226c-7b2b-492a-af8b-932fc06ac26c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:46.002209 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-dd24226c-7b2b-492a-af8b-932fc06ac26c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:46.003245 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-dd24226c-7b2b-492a-af8b-932fc06ac26c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.019s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:46.163998 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-dd24226c-7b2b-492a-af8b-932fc06ac26c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:46.173759 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-dd24226c-7b2b-492a-af8b-932fc06ac26c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:46.175578 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-dd24226c-7b2b-492a-af8b-932fc06ac26c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:46.176911 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-dd24226c-7b2b-492a-af8b-932fc06ac26c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1740 microversion: 2.20 time: 0.208962 Mar 31 18:18:46.177465 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 219/455] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:18:45 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1740 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:18:47.197907 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-da481357-261e-4593-85a1-0754c5cc232b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:18:47.198675 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-da481357-261e-4593-85a1-0754c5cc232b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:18:47.208887 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-da481357-261e-4593-85a1-0754c5cc232b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:47.209429 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-da481357-261e-4593-85a1-0754c5cc232b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:47.210353 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-da481357-261e-4593-85a1-0754c5cc232b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:47.210820 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-da481357-261e-4593-85a1-0754c5cc232b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:47.355115 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-da481357-261e-4593-85a1-0754c5cc232b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:47.363548 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-da481357-261e-4593-85a1-0754c5cc232b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:47.365031 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-da481357-261e-4593-85a1-0754c5cc232b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:47.366172 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-da481357-261e-4593-85a1-0754c5cc232b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1740 microversion: 2.20 time: 0.172865 Mar 31 18:18:47.366750 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 237/456] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:18:47 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1740 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:18:48.384374 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-47ebdb80-32d4-48ac-a6d7-994129eb0fbd tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:18:48.385080 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-47ebdb80-32d4-48ac-a6d7-994129eb0fbd tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:18:48.392806 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-47ebdb80-32d4-48ac-a6d7-994129eb0fbd tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:48.393412 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-47ebdb80-32d4-48ac-a6d7-994129eb0fbd tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:48.394022 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-47ebdb80-32d4-48ac-a6d7-994129eb0fbd tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:48.394448 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-47ebdb80-32d4-48ac-a6d7-994129eb0fbd tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:48.564278 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-47ebdb80-32d4-48ac-a6d7-994129eb0fbd tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:48.572993 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-47ebdb80-32d4-48ac-a6d7-994129eb0fbd tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:48.574644 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-47ebdb80-32d4-48ac-a6d7-994129eb0fbd tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:48.575902 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-47ebdb80-32d4-48ac-a6d7-994129eb0fbd tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1740 microversion: 2.20 time: 0.195286 Mar 31 18:18:48.578955 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 220/457] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:18:48 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1740 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:18:49.596337 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-2fed01c3-db17-4641-8e87-89de31367339 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:18:49.597822 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-2fed01c3-db17-4641-8e87-89de31367339 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:18:49.606131 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-2fed01c3-db17-4641-8e87-89de31367339 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:49.606770 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-2fed01c3-db17-4641-8e87-89de31367339 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:49.607895 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-2fed01c3-db17-4641-8e87-89de31367339 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:49.608453 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-2fed01c3-db17-4641-8e87-89de31367339 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:49.822439 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-2fed01c3-db17-4641-8e87-89de31367339 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:49.833053 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-2fed01c3-db17-4641-8e87-89de31367339 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:49.834715 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-2fed01c3-db17-4641-8e87-89de31367339 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:49.835859 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-2fed01c3-db17-4641-8e87-89de31367339 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1740 microversion: 2.20 time: 0.245093 Mar 31 18:18:49.836591 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 238/458] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:18:49 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1740 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 31 18:18:50.855083 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-a1a6f083-32e0-4bc0-9897-f4dc286d0f7a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:18:50.855711 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-a1a6f083-32e0-4bc0-9897-f4dc286d0f7a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:18:50.862329 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a1a6f083-32e0-4bc0-9897-f4dc286d0f7a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:50.862804 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a1a6f083-32e0-4bc0-9897-f4dc286d0f7a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:50.863552 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a1a6f083-32e0-4bc0-9897-f4dc286d0f7a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:50.863975 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a1a6f083-32e0-4bc0-9897-f4dc286d0f7a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:51.063863 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-a1a6f083-32e0-4bc0-9897-f4dc286d0f7a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:51.071818 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-a1a6f083-32e0-4bc0-9897-f4dc286d0f7a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:51.074392 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-a1a6f083-32e0-4bc0-9897-f4dc286d0f7a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:51.074542 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-a1a6f083-32e0-4bc0-9897-f4dc286d0f7a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1740 microversion: 2.20 time: 0.224239 Mar 31 18:18:51.075034 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 221/459] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:18:50 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1740 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:18:52.456732 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-ecc3e72a-a3ff-4358-a6ee-872d626d9660 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:18:52.456732 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-ecc3e72a-a3ff-4358-a6ee-872d626d9660 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:18:52.463391 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-ecc3e72a-a3ff-4358-a6ee-872d626d9660 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:52.464893 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-ecc3e72a-a3ff-4358-a6ee-872d626d9660 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:52.468948 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-ecc3e72a-a3ff-4358-a6ee-872d626d9660 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:52.470427 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-ecc3e72a-a3ff-4358-a6ee-872d626d9660 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:52.850248 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-ecc3e72a-a3ff-4358-a6ee-872d626d9660 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:52.858108 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-ecc3e72a-a3ff-4358-a6ee-872d626d9660 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:52.859874 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-ecc3e72a-a3ff-4358-a6ee-872d626d9660 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:52.861224 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-ecc3e72a-a3ff-4358-a6ee-872d626d9660 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1740 microversion: 2.20 time: 0.771755 Mar 31 18:18:52.861775 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 239/460] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:18:52 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1740 bytes in 773 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:18:53.880130 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-00ca0ff3-0f5d-48be-bc0a-ff7f87801e7f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:18:53.880719 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-00ca0ff3-0f5d-48be-bc0a-ff7f87801e7f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:18:53.897784 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-00ca0ff3-0f5d-48be-bc0a-ff7f87801e7f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:53.902741 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-00ca0ff3-0f5d-48be-bc0a-ff7f87801e7f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:53.905837 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-00ca0ff3-0f5d-48be-bc0a-ff7f87801e7f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:53.908897 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-00ca0ff3-0f5d-48be-bc0a-ff7f87801e7f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:54.216935 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-00ca0ff3-0f5d-48be-bc0a-ff7f87801e7f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:54.228992 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-00ca0ff3-0f5d-48be-bc0a-ff7f87801e7f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:54.231745 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-00ca0ff3-0f5d-48be-bc0a-ff7f87801e7f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:54.233136 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-00ca0ff3-0f5d-48be-bc0a-ff7f87801e7f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1740 microversion: 2.20 time: 0.356844 Mar 31 18:18:54.233688 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 222/461] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:18:53 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1740 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:18:55.253175 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-2fd92bba-b090-4eca-8a08-bf3905522c68 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:18:55.254212 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-2fd92bba-b090-4eca-8a08-bf3905522c68 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:18:55.260783 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-2fd92bba-b090-4eca-8a08-bf3905522c68 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:55.261304 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-2fd92bba-b090-4eca-8a08-bf3905522c68 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:55.262128 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-2fd92bba-b090-4eca-8a08-bf3905522c68 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:55.263873 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-2fd92bba-b090-4eca-8a08-bf3905522c68 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:55.527420 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-2fd92bba-b090-4eca-8a08-bf3905522c68 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:55.535283 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-2fd92bba-b090-4eca-8a08-bf3905522c68 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:55.536796 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-2fd92bba-b090-4eca-8a08-bf3905522c68 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:55.538881 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-2fd92bba-b090-4eca-8a08-bf3905522c68 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1740 microversion: 2.20 time: 0.289727 Mar 31 18:18:55.539441 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 240/462] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:18:55 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1740 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:18:56.558390 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-3c6c5e2c-4449-4080-8cf7-089f302d7871 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:18:56.559181 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-3c6c5e2c-4449-4080-8cf7-089f302d7871 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:18:56.571402 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3c6c5e2c-4449-4080-8cf7-089f302d7871 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:56.571980 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3c6c5e2c-4449-4080-8cf7-089f302d7871 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:56.573011 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3c6c5e2c-4449-4080-8cf7-089f302d7871 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:56.573627 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3c6c5e2c-4449-4080-8cf7-089f302d7871 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:56.792693 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-3c6c5e2c-4449-4080-8cf7-089f302d7871 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:56.803206 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-3c6c5e2c-4449-4080-8cf7-089f302d7871 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:56.804816 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-3c6c5e2c-4449-4080-8cf7-089f302d7871 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:56.806138 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-3c6c5e2c-4449-4080-8cf7-089f302d7871 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1740 microversion: 2.20 time: 0.251638 Mar 31 18:18:56.807462 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 223/463] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:18:56 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1740 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:18:57.827155 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-b43b83f2-6ab6-4987-a663-25146301bcdc tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:18:57.828267 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-b43b83f2-6ab6-4987-a663-25146301bcdc tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:18:57.835905 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b43b83f2-6ab6-4987-a663-25146301bcdc tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:57.836346 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b43b83f2-6ab6-4987-a663-25146301bcdc tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:57.837147 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b43b83f2-6ab6-4987-a663-25146301bcdc tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:57.837577 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b43b83f2-6ab6-4987-a663-25146301bcdc tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:58.069359 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-b43b83f2-6ab6-4987-a663-25146301bcdc tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:58.078365 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-b43b83f2-6ab6-4987-a663-25146301bcdc tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:58.079903 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-b43b83f2-6ab6-4987-a663-25146301bcdc tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:58.081096 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-b43b83f2-6ab6-4987-a663-25146301bcdc tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1740 microversion: 2.20 time: 0.259696 Mar 31 18:18:58.081640 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 241/464] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:18:57 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1740 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:18:59.100054 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-e6b2945f-8036-4868-8a24-c4d1c84820b7 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:18:59.100986 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-e6b2945f-8036-4868-8a24-c4d1c84820b7 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:18:59.107968 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e6b2945f-8036-4868-8a24-c4d1c84820b7 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:59.108325 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e6b2945f-8036-4868-8a24-c4d1c84820b7 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:59.109098 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e6b2945f-8036-4868-8a24-c4d1c84820b7 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:18:59.109787 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e6b2945f-8036-4868-8a24-c4d1c84820b7 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:18:59.377326 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-e6b2945f-8036-4868-8a24-c4d1c84820b7 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:59.385727 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-e6b2945f-8036-4868-8a24-c4d1c84820b7 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:59.387254 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-e6b2945f-8036-4868-8a24-c4d1c84820b7 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:18:59.389473 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-e6b2945f-8036-4868-8a24-c4d1c84820b7 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1740 microversion: 2.20 time: 0.293936 Mar 31 18:18:59.400587 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 224/465] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:18:59 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1740 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:19:00.419193 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-b38726c9-ab56-4ef2-9e4a-084764ca5f1e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:00.419193 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-b38726c9-ab56-4ef2-9e4a-084764ca5f1e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:00.428943 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b38726c9-ab56-4ef2-9e4a-084764ca5f1e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:00.429397 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b38726c9-ab56-4ef2-9e4a-084764ca5f1e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:00.430395 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b38726c9-ab56-4ef2-9e4a-084764ca5f1e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:00.430863 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b38726c9-ab56-4ef2-9e4a-084764ca5f1e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:00.716457 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-b38726c9-ab56-4ef2-9e4a-084764ca5f1e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:00.740483 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-b38726c9-ab56-4ef2-9e4a-084764ca5f1e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:00.741672 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-b38726c9-ab56-4ef2-9e4a-084764ca5f1e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:00.748336 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-b38726c9-ab56-4ef2-9e4a-084764ca5f1e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1722 microversion: 2.20 time: 0.337696 Mar 31 18:19:00.765459 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 242/466] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:19:00 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1722 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 31 18:19:01.772493 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-704bc93b-1a9d-4308-9789-e1d1f4be2a8b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:01.773109 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-704bc93b-1a9d-4308-9789-e1d1f4be2a8b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:01.785333 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-704bc93b-1a9d-4308-9789-e1d1f4be2a8b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:01.786035 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-704bc93b-1a9d-4308-9789-e1d1f4be2a8b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:01.786999 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-704bc93b-1a9d-4308-9789-e1d1f4be2a8b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:01.787634 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-704bc93b-1a9d-4308-9789-e1d1f4be2a8b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:01.947270 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [req-a05e7332-826f-4500-9a93-7868312ea9ff req-e2176676-612e-45f6-a049-06c923d41b65 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0", "name": "network-vif-unplugged", "status": "completed", "tag": "3bfd294a-f954-4562-8fbf-0cd104ab3bee"}]} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:19:01.963486 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-a05e7332-826f-4500-9a93-7868312ea9ff req-e2176676-612e-45f6-a049-06c923d41b65 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:01.963933 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-a05e7332-826f-4500-9a93-7868312ea9ff req-e2176676-612e-45f6-a049-06c923d41b65 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:01.978114 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.compute.server_external_events [req-a05e7332-826f-4500-9a93-7868312ea9ff req-e2176676-612e-45f6-a049-06c923d41b65 service nova] Creating event network-vif-unplugged:3bfd294a-f954-4562-8fbf-0cd104ab3bee for instance 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 on hv-cinder-maste Mar 31 18:19:01.985714 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [req-a05e7332-826f-4500-9a93-7868312ea9ff req-e2176676-612e-45f6-a049-06c923d41b65 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.044044 Mar 31 18:19:01.988306 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 243/467] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:19:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:19:02.247452 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-704bc93b-1a9d-4308-9789-e1d1f4be2a8b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:02.259516 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-704bc93b-1a9d-4308-9789-e1d1f4be2a8b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:02.261622 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-704bc93b-1a9d-4308-9789-e1d1f4be2a8b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:02.269312 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-704bc93b-1a9d-4308-9789-e1d1f4be2a8b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1722 microversion: 2.20 time: 0.495340 Mar 31 18:19:02.269312 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 225/468] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:19:01 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1722 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:19:03.293166 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-5b558bc0-b4c4-480b-90ad-17f16efea05f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:03.293166 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-5b558bc0-b4c4-480b-90ad-17f16efea05f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:03.295527 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-5b558bc0-b4c4-480b-90ad-17f16efea05f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:03.296035 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-5b558bc0-b4c4-480b-90ad-17f16efea05f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:03.297026 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-5b558bc0-b4c4-480b-90ad-17f16efea05f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:03.297524 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-5b558bc0-b4c4-480b-90ad-17f16efea05f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:03.317264 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-39952fc7-8945-416d-8956-5ed470e74a7d tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-435961487", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1385990206", "security_groups": [{"name": "tempest-secgroup-smoke-888435820"}], "networks": [{"uuid": "c4432959-6b7d-4f95-a29d-a5c36d6927da"}], "block_device_mapping_v2": [{"uuid": "a9a6eb20-5d0e-4cc7-8b28-d0c2790f4d9e", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:19:03.500147 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-5b558bc0-b4c4-480b-90ad-17f16efea05f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:03.511366 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-5b558bc0-b4c4-480b-90ad-17f16efea05f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:03.513506 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-5b558bc0-b4c4-480b-90ad-17f16efea05f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:03.514884 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-5b558bc0-b4c4-480b-90ad-17f16efea05f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1725 microversion: 2.20 time: 0.233066 Mar 31 18:19:03.515538 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 244/469] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:19:03 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1725 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:19:03.532569 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-16bdcdef-a8f5-4efc-8081-791458c0f597 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2d153757-c590-4e61-aef7-f5684031e4f0"}} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:19:03.533613 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-16bdcdef-a8f5-4efc-8081-791458c0f597 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:03.539983 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-16bdcdef-a8f5-4efc-8081-791458c0f597 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:03.540608 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-16bdcdef-a8f5-4efc-8081-791458c0f597 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:03.541559 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-16bdcdef-a8f5-4efc-8081-791458c0f597 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:03.542149 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-16bdcdef-a8f5-4efc-8081-791458c0f597 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:03.548326 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.network.neutron [None req-39952fc7-8945-416d-8956-5ed470e74a7d tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] validate_networks() for [('c4432959-6b7d-4f95-a29d-a5c36d6927da', None, None, None, None, None)] {{(pid=117539) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 31 18:19:04.286713 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.virt.hardware [None req-39952fc7-8945-416d-8956-5ed470e74a7d tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Flavor limits 0:0:0 {{(pid=117539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 31 18:19:04.287152 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.virt.hardware [None req-39952fc7-8945-416d-8956-5ed470e74a7d tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Image limits 0:0:0 {{(pid=117539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 31 18:19:04.287650 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.virt.hardware [None req-39952fc7-8945-416d-8956-5ed470e74a7d tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Flavor pref 0:0:0 {{(pid=117539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 31 18:19:04.288049 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.virt.hardware [None req-39952fc7-8945-416d-8956-5ed470e74a7d tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Image pref 0:0:0 {{(pid=117539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 31 18:19:04.288445 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.virt.hardware [None req-39952fc7-8945-416d-8956-5ed470e74a7d tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 31 18:19:04.297374 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-39952fc7-8945-416d-8956-5ed470e74a7d tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:04.297806 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-39952fc7-8945-416d-8956-5ed470e74a7d tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:04.298593 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-39952fc7-8945-416d-8956-5ed470e74a7d tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:04.299067 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-39952fc7-8945-416d-8956-5ed470e74a7d tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:04.327277 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.quota [None req-39952fc7-8945-416d-8956-5ed470e74a7d tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Getting quotas for project 10c09876736547b59f4bb56fa5740f5f. Resources: {'instances', 'ram', 'cores'} {{(pid=117539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 31 18:19:04.332442 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.quota [None req-39952fc7-8945-416d-8956-5ed470e74a7d tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Getting quotas for user 6f1d5c7f14e2491aa217a7d2939fe962 and project 10c09876736547b59f4bb56fa5740f5f. Resources: {'instances', 'ram', 'cores'} {{(pid=117539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 31 18:19:04.399238 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-39952fc7-8945-416d-8956-5ed470e74a7d tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Going to run 1 instances... {{(pid=117539) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 31 18:19:04.401317 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-39952fc7-8945-416d-8956-5ed470e74a7d tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='a9a6eb20-5d0e-4cc7-8b28-d0c2790f4d9e',volume_size=None,volume_type=None)] {{(pid=117539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 31 18:19:04.581467 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-16bdcdef-a8f5-4efc-8081-791458c0f597 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "POST /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.052775 Mar 31 18:19:04.582118 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 245/470] 10.222.0.58 () {62 vars in 1363 bytes} [Thu Mar 31 18:19:03 2022] POST /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0/os-volume_attachments => generated 188 bytes in 1054 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 31 18:19:04.783163 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-39952fc7-8945-416d-8956-5ed470e74a7d tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.472812 Mar 31 18:19:04.783792 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 226/471] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Mar 31 18:19:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 1475 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 31 18:19:04.788663 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-1920fd49-2461-45c8-901e-322ee1fd2014 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:19:04.788811 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-bad2a4be-ffe8-4aca-abd8-ecdb9982a5f4 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Action: 'create', calling method: .version_select at 0x7fa4d430e9d0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-270850616"}} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:19:04.789558 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-1920fd49-2461-45c8-901e-322ee1fd2014 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:04.797522 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1920fd49-2461-45c8-901e-322ee1fd2014 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:04.799339 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1920fd49-2461-45c8-901e-322ee1fd2014 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:04.800312 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1920fd49-2461-45c8-901e-322ee1fd2014 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:04.800763 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1920fd49-2461-45c8-901e-322ee1fd2014 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:04.811664 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.quota [None req-bad2a4be-ffe8-4aca-abd8-ecdb9982a5f4 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Getting quotas for project 70f0b3390f4542c8831753ecf26f6745. Resources: {'key_pairs'} {{(pid=117538) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 31 18:19:04.815593 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.quota [None req-bad2a4be-ffe8-4aca-abd8-ecdb9982a5f4 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Getting quotas for user 7c5ea90eba174068877cdcc1594ccda4 and project 70f0b3390f4542c8831753ecf26f6745. Resources: {'key_pairs'} {{(pid=117538) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 31 18:19:05.088124 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-1920fd49-2461-45c8-901e-322ee1fd2014 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "POST /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0/action" status: 202 len: 0 microversion: 2.20 time: 0.302884 Mar 31 18:19:05.094126 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 227/472] 10.222.0.58 () {62 vars in 1318 bytes} [Thu Mar 31 18:19:04 2022] POST /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0/action => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 31 18:19:05.095343 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.quota [None req-bad2a4be-ffe8-4aca-abd8-ecdb9982a5f4 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Getting quotas for project 70f0b3390f4542c8831753ecf26f6745. Resources: {'key_pairs'} {{(pid=117538) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 31 18:19:05.099385 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-4195d585-ce84-4870-93e0-6069e7d6fb84 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:05.100592 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.quota [None req-bad2a4be-ffe8-4aca-abd8-ecdb9982a5f4 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Getting quotas for user 7c5ea90eba174068877cdcc1594ccda4 and project 70f0b3390f4542c8831753ecf26f6745. Resources: {'key_pairs'} {{(pid=117538) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 31 18:19:05.101411 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-4195d585-ce84-4870-93e0-6069e7d6fb84 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:05.117505 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-bad2a4be-ffe8-4aca-abd8-ecdb9982a5f4 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 2318 microversion: 2.1 time: 0.534251 Mar 31 18:19:05.118295 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 246/473] 10.222.0.58 () {60 vars in 1157 bytes} [Thu Mar 31 18:19:04 2022] POST /compute/v2.1/os-keypairs => generated 2318 bytes in 536 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:19:05.123932 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-c07eecd1-1c49-4ce0-a1ea-40ada80ee1f9 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:05.124780 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-c07eecd1-1c49-4ce0-a1ea-40ada80ee1f9 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:05.132211 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c07eecd1-1c49-4ce0-a1ea-40ada80ee1f9 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:05.133402 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c07eecd1-1c49-4ce0-a1ea-40ada80ee1f9 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:05.134859 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c07eecd1-1c49-4ce0-a1ea-40ada80ee1f9 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:05.137301 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c07eecd1-1c49-4ce0-a1ea-40ada80ee1f9 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:05.179662 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-4195d585-ce84-4870-93e0-6069e7d6fb84 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:05.193996 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-4195d585-ce84-4870-93e0-6069e7d6fb84 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1088 microversion: 2.1 time: 0.097064 Mar 31 18:19:05.194757 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 228/474] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:05 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1088 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:19:05.358776 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-c07eecd1-1c49-4ce0-a1ea-40ada80ee1f9 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:05.377337 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-c07eecd1-1c49-4ce0-a1ea-40ada80ee1f9 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:05.379456 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-c07eecd1-1c49-4ce0-a1ea-40ada80ee1f9 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:05.381890 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-c07eecd1-1c49-4ce0-a1ea-40ada80ee1f9 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1751 microversion: 2.20 time: 0.262529 Mar 31 18:19:05.382840 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 247/475] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:19:05 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1751 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:19:06.212155 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-fe2dadaf-383e-4c05-80f6-125cfc98654a tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:06.213597 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-fe2dadaf-383e-4c05-80f6-125cfc98654a tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:06.222509 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-fe2dadaf-383e-4c05-80f6-125cfc98654a tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:06.224330 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-fe2dadaf-383e-4c05-80f6-125cfc98654a tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:06.225739 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-fe2dadaf-383e-4c05-80f6-125cfc98654a tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:06.226314 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-fe2dadaf-383e-4c05-80f6-125cfc98654a tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:06.332072 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-fe2dadaf-383e-4c05-80f6-125cfc98654a tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:06.342503 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-fe2dadaf-383e-4c05-80f6-125cfc98654a tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1138 microversion: 2.1 time: 0.132832 Mar 31 18:19:06.353102 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 229/476] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:06 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1138 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:19:06.400534 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-5b26809b-ba4b-490c-9dfe-43a74acb2332 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:06.401131 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-5b26809b-ba4b-490c-9dfe-43a74acb2332 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:06.408215 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-5b26809b-ba4b-490c-9dfe-43a74acb2332 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:06.408779 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-5b26809b-ba4b-490c-9dfe-43a74acb2332 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:06.409543 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-5b26809b-ba4b-490c-9dfe-43a74acb2332 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:06.409967 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-5b26809b-ba4b-490c-9dfe-43a74acb2332 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:06.581950 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-5b26809b-ba4b-490c-9dfe-43a74acb2332 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:06.608382 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-5b26809b-ba4b-490c-9dfe-43a74acb2332 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:06.617566 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-5b26809b-ba4b-490c-9dfe-43a74acb2332 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:06.619196 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-5b26809b-ba4b-490c-9dfe-43a74acb2332 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1751 microversion: 2.20 time: 0.222768 Mar 31 18:19:06.627719 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 248/477] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:19:06 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1751 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:19:07.360603 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-f3588ab9-b564-40c0-8c24-5a7be089a4e9 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:07.361205 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-f3588ab9-b564-40c0-8c24-5a7be089a4e9 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:07.367244 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-f3588ab9-b564-40c0-8c24-5a7be089a4e9 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:07.367716 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-f3588ab9-b564-40c0-8c24-5a7be089a4e9 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:07.368535 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-f3588ab9-b564-40c0-8c24-5a7be089a4e9 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:07.368962 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-f3588ab9-b564-40c0-8c24-5a7be089a4e9 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:07.433977 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-f3588ab9-b564-40c0-8c24-5a7be089a4e9 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:07.442240 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-f3588ab9-b564-40c0-8c24-5a7be089a4e9 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1186 microversion: 2.1 time: 0.085603 Mar 31 18:19:07.443366 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 230/478] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:07 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1186 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:19:07.641262 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-f426aa94-2650-4f39-a63a-5db4aa1ba47b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:07.642080 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-f426aa94-2650-4f39-a63a-5db4aa1ba47b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:07.649271 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f426aa94-2650-4f39-a63a-5db4aa1ba47b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:07.649639 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f426aa94-2650-4f39-a63a-5db4aa1ba47b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:07.651516 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f426aa94-2650-4f39-a63a-5db4aa1ba47b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:07.652147 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f426aa94-2650-4f39-a63a-5db4aa1ba47b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:07.910779 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-f426aa94-2650-4f39-a63a-5db4aa1ba47b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:07.919570 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-f426aa94-2650-4f39-a63a-5db4aa1ba47b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:07.921128 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-f426aa94-2650-4f39-a63a-5db4aa1ba47b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:07.922431 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-f426aa94-2650-4f39-a63a-5db4aa1ba47b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1753 microversion: 2.20 time: 0.286658 Mar 31 18:19:07.926651 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 249/479] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:19:07 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1753 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:19:08.459665 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-e39460f9-8554-491c-a0a4-efbfef658724 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:08.460261 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-e39460f9-8554-491c-a0a4-efbfef658724 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:08.467614 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e39460f9-8554-491c-a0a4-efbfef658724 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:08.468339 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e39460f9-8554-491c-a0a4-efbfef658724 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:08.469280 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e39460f9-8554-491c-a0a4-efbfef658724 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:08.469713 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e39460f9-8554-491c-a0a4-efbfef658724 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:08.664865 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-e39460f9-8554-491c-a0a4-efbfef658724 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:08.673914 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-e39460f9-8554-491c-a0a4-efbfef658724 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1271 microversion: 2.1 time: 0.217904 Mar 31 18:19:08.674494 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 231/480] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:08 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1271 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:19:08.947350 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-cddb22ce-baeb-4fa9-91dd-8b22642d6db0 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:08.948667 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-cddb22ce-baeb-4fa9-91dd-8b22642d6db0 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:08.955587 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-cddb22ce-baeb-4fa9-91dd-8b22642d6db0 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:08.956040 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-cddb22ce-baeb-4fa9-91dd-8b22642d6db0 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:08.956814 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-cddb22ce-baeb-4fa9-91dd-8b22642d6db0 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:08.957240 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-cddb22ce-baeb-4fa9-91dd-8b22642d6db0 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:09.203956 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-cddb22ce-baeb-4fa9-91dd-8b22642d6db0 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:09.213470 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-cddb22ce-baeb-4fa9-91dd-8b22642d6db0 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:09.214903 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-cddb22ce-baeb-4fa9-91dd-8b22642d6db0 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:09.216251 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-cddb22ce-baeb-4fa9-91dd-8b22642d6db0 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1809 microversion: 2.20 time: 0.273025 Mar 31 18:19:09.231443 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 250/481] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:19:08 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1809 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:19:09.607707 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 31 18:19:09.608138 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: Thu Mar 31 18:19:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 31 18:19:09.691393 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-3952f74d-c789-4982-ae4b-58cee7b91f98 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:09.691991 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-3952f74d-c789-4982-ae4b-58cee7b91f98 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:09.697916 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3952f74d-c789-4982-ae4b-58cee7b91f98 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:09.698351 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3952f74d-c789-4982-ae4b-58cee7b91f98 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:09.699785 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3952f74d-c789-4982-ae4b-58cee7b91f98 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:09.700237 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3952f74d-c789-4982-ae4b-58cee7b91f98 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:09.854213 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-3952f74d-c789-4982-ae4b-58cee7b91f98 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:09.861824 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-3952f74d-c789-4982-ae4b-58cee7b91f98 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1271 microversion: 2.1 time: 0.174564 Mar 31 18:19:09.862382 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 232/482] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:09 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1271 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:19:09.951607 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [req-3e0d84ee-9c5e-4693-bbad-39dcfbe6f4af req-453aed02-0421-43b3-a35d-be26e16e1ab9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61abeff2-268a-4149-9962-497c409663ed", "tag": "156f9ff9-ec0d-4ac3-a7d7-2fa14dbead9a"}]} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:19:09.961062 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-3e0d84ee-9c5e-4693-bbad-39dcfbe6f4af req-453aed02-0421-43b3-a35d-be26e16e1ab9 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:09.961499 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-3e0d84ee-9c5e-4693-bbad-39dcfbe6f4af req-453aed02-0421-43b3-a35d-be26e16e1ab9 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:09.975652 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.compute.server_external_events [req-3e0d84ee-9c5e-4693-bbad-39dcfbe6f4af req-453aed02-0421-43b3-a35d-be26e16e1ab9 service nova] Creating event network-changed:156f9ff9-ec0d-4ac3-a7d7-2fa14dbead9a for instance 61abeff2-268a-4149-9962-497c409663ed on hv-cinder-maste Mar 31 18:19:09.979083 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [req-3e0d84ee-9c5e-4693-bbad-39dcfbe6f4af req-453aed02-0421-43b3-a35d-be26e16e1ab9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.097817 Mar 31 18:19:09.979995 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 251/483] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:19:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 31 18:19:10.235065 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-a591d37e-a0a0-4b47-9efb-01b0c692377a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:10.235665 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-a591d37e-a0a0-4b47-9efb-01b0c692377a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:10.241437 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a591d37e-a0a0-4b47-9efb-01b0c692377a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:10.241940 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a591d37e-a0a0-4b47-9efb-01b0c692377a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:10.243482 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a591d37e-a0a0-4b47-9efb-01b0c692377a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:10.244103 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a591d37e-a0a0-4b47-9efb-01b0c692377a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:10.395986 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-a591d37e-a0a0-4b47-9efb-01b0c692377a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:10.405016 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-a591d37e-a0a0-4b47-9efb-01b0c692377a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:10.414059 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-a591d37e-a0a0-4b47-9efb-01b0c692377a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:10.416265 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-a591d37e-a0a0-4b47-9efb-01b0c692377a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1809 microversion: 2.20 time: 0.185735 Mar 31 18:19:10.416855 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 233/484] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:19:10 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1809 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:19:10.879335 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-a46a39e5-a876-4e94-bf8a-c493ab8c0e63 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:10.879972 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-a46a39e5-a876-4e94-bf8a-c493ab8c0e63 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:10.887044 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a46a39e5-a876-4e94-bf8a-c493ab8c0e63 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:10.888146 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a46a39e5-a876-4e94-bf8a-c493ab8c0e63 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:10.889084 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a46a39e5-a876-4e94-bf8a-c493ab8c0e63 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:10.889409 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a46a39e5-a876-4e94-bf8a-c493ab8c0e63 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:11.206720 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-a46a39e5-a876-4e94-bf8a-c493ab8c0e63 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:11.220484 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-a46a39e5-a876-4e94-bf8a-c493ab8c0e63 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1259 microversion: 2.1 time: 0.345422 Mar 31 18:19:11.231802 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 252/485] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:10 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1259 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:19:11.442749 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-55f8d570-d9c6-4fe5-b0e2-2eba652e43a1 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:11.444402 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-55f8d570-d9c6-4fe5-b0e2-2eba652e43a1 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:11.451954 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-55f8d570-d9c6-4fe5-b0e2-2eba652e43a1 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:11.452642 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-55f8d570-d9c6-4fe5-b0e2-2eba652e43a1 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:11.453645 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-55f8d570-d9c6-4fe5-b0e2-2eba652e43a1 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:11.454299 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-55f8d570-d9c6-4fe5-b0e2-2eba652e43a1 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:11.659294 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-55f8d570-d9c6-4fe5-b0e2-2eba652e43a1 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:11.668806 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-55f8d570-d9c6-4fe5-b0e2-2eba652e43a1 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:11.670573 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-55f8d570-d9c6-4fe5-b0e2-2eba652e43a1 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:11.671748 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-55f8d570-d9c6-4fe5-b0e2-2eba652e43a1 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1809 microversion: 2.20 time: 0.235924 Mar 31 18:19:11.672303 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 234/486] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:19:11 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1809 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:19:12.238515 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-fcae921b-487d-456c-b0f8-a2c693c29e7e tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:12.240037 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-fcae921b-487d-456c-b0f8-a2c693c29e7e tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:12.247503 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-fcae921b-487d-456c-b0f8-a2c693c29e7e tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:12.248520 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-fcae921b-487d-456c-b0f8-a2c693c29e7e tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:12.248730 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-fcae921b-487d-456c-b0f8-a2c693c29e7e tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:12.249170 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-fcae921b-487d-456c-b0f8-a2c693c29e7e tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:12.462870 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-fcae921b-487d-456c-b0f8-a2c693c29e7e tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:12.471289 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-fcae921b-487d-456c-b0f8-a2c693c29e7e tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1259 microversion: 2.1 time: 0.237288 Mar 31 18:19:12.471784 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 253/487] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:12 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1259 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:19:12.689856 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-c36962e0-899a-4b50-8a08-b7787eff985f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:12.690459 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-c36962e0-899a-4b50-8a08-b7787eff985f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:12.696609 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c36962e0-899a-4b50-8a08-b7787eff985f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:12.697049 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c36962e0-899a-4b50-8a08-b7787eff985f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:12.697804 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c36962e0-899a-4b50-8a08-b7787eff985f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:12.698225 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c36962e0-899a-4b50-8a08-b7787eff985f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:13.033157 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-c36962e0-899a-4b50-8a08-b7787eff985f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:13.044518 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-c36962e0-899a-4b50-8a08-b7787eff985f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:13.047808 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-c36962e0-899a-4b50-8a08-b7787eff985f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:13.049456 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-c36962e0-899a-4b50-8a08-b7787eff985f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1809 microversion: 2.20 time: 0.363428 Mar 31 18:19:13.050279 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 235/488] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:19:12 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1809 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:19:13.488651 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-8ff09444-a01e-4563-a74d-0fed8f591b52 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:13.489256 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-8ff09444-a01e-4563-a74d-0fed8f591b52 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:13.495596 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8ff09444-a01e-4563-a74d-0fed8f591b52 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:13.496130 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8ff09444-a01e-4563-a74d-0fed8f591b52 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:13.497145 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8ff09444-a01e-4563-a74d-0fed8f591b52 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:13.497576 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8ff09444-a01e-4563-a74d-0fed8f591b52 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:13.648904 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-8ff09444-a01e-4563-a74d-0fed8f591b52 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:13.656589 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-8ff09444-a01e-4563-a74d-0fed8f591b52 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1259 microversion: 2.1 time: 0.171850 Mar 31 18:19:13.657153 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 254/489] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:13 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1259 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:19:14.068409 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-1dd20d08-679c-4671-aa31-f29dd64b0afd tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:14.069090 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-1dd20d08-679c-4671-aa31-f29dd64b0afd tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:14.075647 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1dd20d08-679c-4671-aa31-f29dd64b0afd tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:14.076093 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1dd20d08-679c-4671-aa31-f29dd64b0afd tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:14.076945 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1dd20d08-679c-4671-aa31-f29dd64b0afd tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:14.077380 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1dd20d08-679c-4671-aa31-f29dd64b0afd tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:14.219451 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-1dd20d08-679c-4671-aa31-f29dd64b0afd tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:14.227659 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-1dd20d08-679c-4671-aa31-f29dd64b0afd tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:14.229136 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-1dd20d08-679c-4671-aa31-f29dd64b0afd tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:14.230267 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-1dd20d08-679c-4671-aa31-f29dd64b0afd tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1809 microversion: 2.20 time: 0.165996 Mar 31 18:19:14.231474 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 236/490] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:19:14 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1809 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:19:14.675478 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-9d49ea2b-5ce2-4911-a489-a248de746047 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:14.676187 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-9d49ea2b-5ce2-4911-a489-a248de746047 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:14.683001 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9d49ea2b-5ce2-4911-a489-a248de746047 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:14.683759 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9d49ea2b-5ce2-4911-a489-a248de746047 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:14.684762 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9d49ea2b-5ce2-4911-a489-a248de746047 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:14.685198 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9d49ea2b-5ce2-4911-a489-a248de746047 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:14.832442 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-9d49ea2b-5ce2-4911-a489-a248de746047 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:14.844029 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-9d49ea2b-5ce2-4911-a489-a248de746047 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1259 microversion: 2.1 time: 0.173421 Mar 31 18:19:14.845408 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 255/491] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:14 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1259 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:19:15.249578 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-8cf8af39-3677-4750-857f-05462c7e725a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:15.250219 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-8cf8af39-3677-4750-857f-05462c7e725a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:15.256061 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-8cf8af39-3677-4750-857f-05462c7e725a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:15.256489 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-8cf8af39-3677-4750-857f-05462c7e725a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:15.257228 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-8cf8af39-3677-4750-857f-05462c7e725a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:15.257649 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-8cf8af39-3677-4750-857f-05462c7e725a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:15.399479 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-8cf8af39-3677-4750-857f-05462c7e725a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:15.408547 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-8cf8af39-3677-4750-857f-05462c7e725a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:15.410049 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-8cf8af39-3677-4750-857f-05462c7e725a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:15.411234 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-8cf8af39-3677-4750-857f-05462c7e725a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1809 microversion: 2.20 time: 0.166356 Mar 31 18:19:15.413494 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 237/492] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:19:15 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:19:15.861949 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-a0eea07a-62aa-43a6-be75-f834a22f72d1 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:15.862588 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-a0eea07a-62aa-43a6-be75-f834a22f72d1 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:15.869335 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a0eea07a-62aa-43a6-be75-f834a22f72d1 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:15.869858 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a0eea07a-62aa-43a6-be75-f834a22f72d1 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:15.870633 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a0eea07a-62aa-43a6-be75-f834a22f72d1 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:15.871348 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a0eea07a-62aa-43a6-be75-f834a22f72d1 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:16.044779 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-a0eea07a-62aa-43a6-be75-f834a22f72d1 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:16.064600 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-a0eea07a-62aa-43a6-be75-f834a22f72d1 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1259 microversion: 2.1 time: 0.204919 Mar 31 18:19:16.065454 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 256/493] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:15 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1259 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:19:16.434043 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-1ef8d7f0-1715-4d58-9915-2e187406e1aa tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:16.439311 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-1ef8d7f0-1715-4d58-9915-2e187406e1aa tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:16.448606 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1ef8d7f0-1715-4d58-9915-2e187406e1aa tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:16.449727 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1ef8d7f0-1715-4d58-9915-2e187406e1aa tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:16.453503 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1ef8d7f0-1715-4d58-9915-2e187406e1aa tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:16.454074 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1ef8d7f0-1715-4d58-9915-2e187406e1aa tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:16.625039 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-1ef8d7f0-1715-4d58-9915-2e187406e1aa tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:16.635039 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-1ef8d7f0-1715-4d58-9915-2e187406e1aa tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:16.637830 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-1ef8d7f0-1715-4d58-9915-2e187406e1aa tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:16.639268 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-1ef8d7f0-1715-4d58-9915-2e187406e1aa tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1809 microversion: 2.20 time: 0.212328 Mar 31 18:19:16.642655 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 238/494] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:19:16 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1809 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:19:17.081275 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-aafbc736-f04e-4c1d-ac14-c4dd21180809 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:17.081982 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-aafbc736-f04e-4c1d-ac14-c4dd21180809 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:17.088913 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-aafbc736-f04e-4c1d-ac14-c4dd21180809 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:17.089358 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-aafbc736-f04e-4c1d-ac14-c4dd21180809 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:17.090161 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-aafbc736-f04e-4c1d-ac14-c4dd21180809 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:17.090817 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-aafbc736-f04e-4c1d-ac14-c4dd21180809 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:17.237395 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-aafbc736-f04e-4c1d-ac14-c4dd21180809 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:17.243089 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-aafbc736-f04e-4c1d-ac14-c4dd21180809 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1259 microversion: 2.1 time: 0.165706 Mar 31 18:19:17.243650 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 257/495] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:17 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1259 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:19:17.661172 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-39ea4c54-2936-4ef2-a432-7b6edf4d79f2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:17.661782 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-39ea4c54-2936-4ef2-a432-7b6edf4d79f2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:17.668574 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-39ea4c54-2936-4ef2-a432-7b6edf4d79f2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:17.668574 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-39ea4c54-2936-4ef2-a432-7b6edf4d79f2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:17.669021 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-39ea4c54-2936-4ef2-a432-7b6edf4d79f2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:17.669471 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-39ea4c54-2936-4ef2-a432-7b6edf4d79f2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:17.820690 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-39ea4c54-2936-4ef2-a432-7b6edf4d79f2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:17.829643 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-39ea4c54-2936-4ef2-a432-7b6edf4d79f2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:17.831192 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-39ea4c54-2936-4ef2-a432-7b6edf4d79f2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:17.832334 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-39ea4c54-2936-4ef2-a432-7b6edf4d79f2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1809 microversion: 2.20 time: 0.175061 Mar 31 18:19:17.832912 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 239/496] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:19:17 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:19:18.259622 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-cda03ca4-8940-4509-8a7e-1ac7ff6b329e tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:18.260244 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-cda03ca4-8940-4509-8a7e-1ac7ff6b329e tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:18.267152 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-cda03ca4-8940-4509-8a7e-1ac7ff6b329e tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:18.267588 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-cda03ca4-8940-4509-8a7e-1ac7ff6b329e tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:18.268409 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-cda03ca4-8940-4509-8a7e-1ac7ff6b329e tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:18.268847 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-cda03ca4-8940-4509-8a7e-1ac7ff6b329e tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:18.411869 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-cda03ca4-8940-4509-8a7e-1ac7ff6b329e tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:18.419428 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-cda03ca4-8940-4509-8a7e-1ac7ff6b329e tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1259 microversion: 2.1 time: 0.163728 Mar 31 18:19:18.419989 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 258/497] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:18 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:19:18.851454 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-0aad365d-31c9-4e8f-9d50-77d4a474e9a0 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:18.852366 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-0aad365d-31c9-4e8f-9d50-77d4a474e9a0 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:18.858562 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0aad365d-31c9-4e8f-9d50-77d4a474e9a0 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:18.859267 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0aad365d-31c9-4e8f-9d50-77d4a474e9a0 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:18.860209 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0aad365d-31c9-4e8f-9d50-77d4a474e9a0 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:18.860793 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0aad365d-31c9-4e8f-9d50-77d4a474e9a0 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:19.002706 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-0aad365d-31c9-4e8f-9d50-77d4a474e9a0 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:19.014188 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-0aad365d-31c9-4e8f-9d50-77d4a474e9a0 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:19.015845 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-0aad365d-31c9-4e8f-9d50-77d4a474e9a0 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:19.017194 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-0aad365d-31c9-4e8f-9d50-77d4a474e9a0 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1809 microversion: 2.20 time: 0.169708 Mar 31 18:19:19.017760 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 240/498] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:19:18 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:19:19.437032 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-c67dc565-26d8-48e6-8b9c-2ac069955cfa tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:19.437652 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-c67dc565-26d8-48e6-8b9c-2ac069955cfa tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:19.444332 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c67dc565-26d8-48e6-8b9c-2ac069955cfa tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:19.444783 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c67dc565-26d8-48e6-8b9c-2ac069955cfa tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:19.445555 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c67dc565-26d8-48e6-8b9c-2ac069955cfa tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:19.445990 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c67dc565-26d8-48e6-8b9c-2ac069955cfa tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:19.601383 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-c67dc565-26d8-48e6-8b9c-2ac069955cfa tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:19.609613 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-c67dc565-26d8-48e6-8b9c-2ac069955cfa tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1259 microversion: 2.1 time: 0.177055 Mar 31 18:19:19.610168 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 259/499] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:19 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1259 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:19:20.036681 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-4b4b4e29-1449-441b-b5e8-8f80172423ab tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:20.037507 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-4b4b4e29-1449-441b-b5e8-8f80172423ab tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:20.044167 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-4b4b4e29-1449-441b-b5e8-8f80172423ab tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:20.044607 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-4b4b4e29-1449-441b-b5e8-8f80172423ab tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:20.045363 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-4b4b4e29-1449-441b-b5e8-8f80172423ab tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:20.045784 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-4b4b4e29-1449-441b-b5e8-8f80172423ab tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:20.189742 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-4b4b4e29-1449-441b-b5e8-8f80172423ab tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:20.198242 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-4b4b4e29-1449-441b-b5e8-8f80172423ab tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:20.200139 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-4b4b4e29-1449-441b-b5e8-8f80172423ab tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:20.201379 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-4b4b4e29-1449-441b-b5e8-8f80172423ab tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1809 microversion: 2.20 time: 0.169072 Mar 31 18:19:20.204121 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 241/500] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:19:20 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:19:20.627972 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-dd234597-990c-4e7e-aa95-7f76493fb626 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:20.628548 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-dd234597-990c-4e7e-aa95-7f76493fb626 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:20.634657 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-dd234597-990c-4e7e-aa95-7f76493fb626 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:20.635101 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-dd234597-990c-4e7e-aa95-7f76493fb626 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:20.635844 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-dd234597-990c-4e7e-aa95-7f76493fb626 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:20.636979 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-dd234597-990c-4e7e-aa95-7f76493fb626 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:20.773693 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-dd234597-990c-4e7e-aa95-7f76493fb626 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:20.781795 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-dd234597-990c-4e7e-aa95-7f76493fb626 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1259 microversion: 2.1 time: 0.157731 Mar 31 18:19:20.791413 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 260/501] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:20 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1259 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:19:21.220066 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-9b9853e6-7a6f-44e7-9409-1d01b5279322 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:21.221369 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-9b9853e6-7a6f-44e7-9409-1d01b5279322 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:21.232494 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9b9853e6-7a6f-44e7-9409-1d01b5279322 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:21.233266 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9b9853e6-7a6f-44e7-9409-1d01b5279322 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:21.234238 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9b9853e6-7a6f-44e7-9409-1d01b5279322 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:21.234919 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9b9853e6-7a6f-44e7-9409-1d01b5279322 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:21.376118 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-9b9853e6-7a6f-44e7-9409-1d01b5279322 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:21.384747 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-9b9853e6-7a6f-44e7-9409-1d01b5279322 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:21.387031 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-9b9853e6-7a6f-44e7-9409-1d01b5279322 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:21.388378 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-9b9853e6-7a6f-44e7-9409-1d01b5279322 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1809 microversion: 2.20 time: 0.173011 Mar 31 18:19:21.397776 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 242/502] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:19:21 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1809 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:19:21.799936 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-6309c324-971d-4fc9-b143-97ea74370ee0 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:21.805291 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-6309c324-971d-4fc9-b143-97ea74370ee0 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:21.807762 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6309c324-971d-4fc9-b143-97ea74370ee0 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:21.808978 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6309c324-971d-4fc9-b143-97ea74370ee0 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:21.809790 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6309c324-971d-4fc9-b143-97ea74370ee0 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:21.810255 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6309c324-971d-4fc9-b143-97ea74370ee0 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:21.973835 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-6309c324-971d-4fc9-b143-97ea74370ee0 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:21.981683 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-6309c324-971d-4fc9-b143-97ea74370ee0 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1259 microversion: 2.1 time: 0.185897 Mar 31 18:19:21.982237 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 261/503] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:21 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1259 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:19:22.408425 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-7fbbac9a-a6d4-40b4-934d-d695d7356797 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:22.408978 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-7fbbac9a-a6d4-40b4-934d-d695d7356797 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:22.414792 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-7fbbac9a-a6d4-40b4-934d-d695d7356797 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:22.415231 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-7fbbac9a-a6d4-40b4-934d-d695d7356797 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:22.415981 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-7fbbac9a-a6d4-40b4-934d-d695d7356797 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:22.416407 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-7fbbac9a-a6d4-40b4-934d-d695d7356797 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:22.550763 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-7fbbac9a-a6d4-40b4-934d-d695d7356797 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:22.559668 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-7fbbac9a-a6d4-40b4-934d-d695d7356797 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:22.561432 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-7fbbac9a-a6d4-40b4-934d-d695d7356797 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:22.562591 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-7fbbac9a-a6d4-40b4-934d-d695d7356797 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1809 microversion: 2.20 time: 0.158176 Mar 31 18:19:22.563167 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 243/504] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:19:22 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:19:22.999061 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-adb69dac-c31f-4ab0-a870-40f38196ab01 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:22.999613 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-adb69dac-c31f-4ab0-a870-40f38196ab01 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:23.006390 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-adb69dac-c31f-4ab0-a870-40f38196ab01 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:23.007125 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-adb69dac-c31f-4ab0-a870-40f38196ab01 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:23.007969 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-adb69dac-c31f-4ab0-a870-40f38196ab01 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:23.008524 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-adb69dac-c31f-4ab0-a870-40f38196ab01 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:23.144889 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-adb69dac-c31f-4ab0-a870-40f38196ab01 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:23.152289 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-adb69dac-c31f-4ab0-a870-40f38196ab01 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1259 microversion: 2.1 time: 0.157849 Mar 31 18:19:23.155155 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 262/505] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:22 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:19:23.580210 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-4293b613-c885-4952-a906-88173d92ded2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:23.580955 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-4293b613-c885-4952-a906-88173d92ded2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:23.586891 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-4293b613-c885-4952-a906-88173d92ded2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:23.587332 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-4293b613-c885-4952-a906-88173d92ded2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:23.588113 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-4293b613-c885-4952-a906-88173d92ded2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:23.588540 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-4293b613-c885-4952-a906-88173d92ded2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:23.722405 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-4293b613-c885-4952-a906-88173d92ded2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:23.730664 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-4293b613-c885-4952-a906-88173d92ded2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:23.732219 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-4293b613-c885-4952-a906-88173d92ded2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:23.733357 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-4293b613-c885-4952-a906-88173d92ded2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1809 microversion: 2.20 time: 0.157046 Mar 31 18:19:23.733926 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 244/506] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:19:23 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:19:24.108916 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-328818c6-9eb1-4847-a7b8-ba5aa163da71 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d8adbe01-d460-446c-bf13-348f060af096"}} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:19:24.110017 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-328818c6-9eb1-4847-a7b8-ba5aa163da71 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: a2498a53-f6d8-4236-8788-289622fc2c88] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:24.115753 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-328818c6-9eb1-4847-a7b8-ba5aa163da71 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:24.116191 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-328818c6-9eb1-4847-a7b8-ba5aa163da71 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:24.116937 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-328818c6-9eb1-4847-a7b8-ba5aa163da71 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:24.117365 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-328818c6-9eb1-4847-a7b8-ba5aa163da71 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:24.169119 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-e1d85b67-bf79-4259-a40f-0d8caa5f0d81 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:24.169961 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-e1d85b67-bf79-4259-a40f-0d8caa5f0d81 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:24.175647 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e1d85b67-bf79-4259-a40f-0d8caa5f0d81 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:24.176083 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e1d85b67-bf79-4259-a40f-0d8caa5f0d81 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:24.176829 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e1d85b67-bf79-4259-a40f-0d8caa5f0d81 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:24.177251 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e1d85b67-bf79-4259-a40f-0d8caa5f0d81 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:24.311348 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-e1d85b67-bf79-4259-a40f-0d8caa5f0d81 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:24.318562 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-e1d85b67-bf79-4259-a40f-0d8caa5f0d81 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1259 microversion: 2.1 time: 0.153234 Mar 31 18:19:24.319148 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 245/507] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:24 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:19:24.751529 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-50854c0e-c040-4fc8-8890-089f6f52b61b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:24.752194 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-50854c0e-c040-4fc8-8890-089f6f52b61b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:24.757854 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-50854c0e-c040-4fc8-8890-089f6f52b61b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:24.758299 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-50854c0e-c040-4fc8-8890-089f6f52b61b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:24.759078 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-50854c0e-c040-4fc8-8890-089f6f52b61b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:24.759506 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-50854c0e-c040-4fc8-8890-089f6f52b61b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:24.896167 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-50854c0e-c040-4fc8-8890-089f6f52b61b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:24.904318 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-50854c0e-c040-4fc8-8890-089f6f52b61b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:24.905791 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-50854c0e-c040-4fc8-8890-089f6f52b61b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:24.906944 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-50854c0e-c040-4fc8-8890-089f6f52b61b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1809 microversion: 2.20 time: 0.159333 Mar 31 18:19:24.907493 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 246/508] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:19:24 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 31 18:19:25.336086 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-0bdcf9a4-d93a-49ee-b3c4-3e7cd3203851 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:25.336612 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-0bdcf9a4-d93a-49ee-b3c4-3e7cd3203851 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:25.345274 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0bdcf9a4-d93a-49ee-b3c4-3e7cd3203851 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:25.345711 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0bdcf9a4-d93a-49ee-b3c4-3e7cd3203851 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:25.346478 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0bdcf9a4-d93a-49ee-b3c4-3e7cd3203851 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:25.346941 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0bdcf9a4-d93a-49ee-b3c4-3e7cd3203851 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:25.478472 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-0bdcf9a4-d93a-49ee-b3c4-3e7cd3203851 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:25.486218 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-0bdcf9a4-d93a-49ee-b3c4-3e7cd3203851 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1259 microversion: 2.1 time: 0.154107 Mar 31 18:19:25.486806 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 247/509] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:25 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:19:25.925092 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-ac60e365-8b0e-442e-ba6f-21d8c47b4557 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:25.925730 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-ac60e365-8b0e-442e-ba6f-21d8c47b4557 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:25.931566 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ac60e365-8b0e-442e-ba6f-21d8c47b4557 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:25.932007 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ac60e365-8b0e-442e-ba6f-21d8c47b4557 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:25.933330 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ac60e365-8b0e-442e-ba6f-21d8c47b4557 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:25.933857 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ac60e365-8b0e-442e-ba6f-21d8c47b4557 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:26.073266 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-ac60e365-8b0e-442e-ba6f-21d8c47b4557 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:26.081667 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-ac60e365-8b0e-442e-ba6f-21d8c47b4557 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:26.083224 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-ac60e365-8b0e-442e-ba6f-21d8c47b4557 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:26.084359 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-ac60e365-8b0e-442e-ba6f-21d8c47b4557 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1809 microversion: 2.20 time: 0.163175 Mar 31 18:19:26.084905 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 248/510] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:19:25 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 31 18:19:26.502714 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-a174ecb2-f859-4121-80d1-35e496061854 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:26.503321 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-a174ecb2-f859-4121-80d1-35e496061854 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:26.509157 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a174ecb2-f859-4121-80d1-35e496061854 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:26.509599 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a174ecb2-f859-4121-80d1-35e496061854 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:26.510377 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a174ecb2-f859-4121-80d1-35e496061854 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:26.510838 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a174ecb2-f859-4121-80d1-35e496061854 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:26.642602 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-a174ecb2-f859-4121-80d1-35e496061854 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:26.649786 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-a174ecb2-f859-4121-80d1-35e496061854 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1259 microversion: 2.1 time: 0.150925 Mar 31 18:19:26.650353 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 249/511] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:26 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:19:27.102790 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-e06024b4-3eec-4217-8099-5aa4e33535d5 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:27.103463 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-e06024b4-3eec-4217-8099-5aa4e33535d5 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:27.109183 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e06024b4-3eec-4217-8099-5aa4e33535d5 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:27.109624 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e06024b4-3eec-4217-8099-5aa4e33535d5 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:27.110382 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e06024b4-3eec-4217-8099-5aa4e33535d5 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:27.110833 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e06024b4-3eec-4217-8099-5aa4e33535d5 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:27.240243 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-e06024b4-3eec-4217-8099-5aa4e33535d5 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:27.249033 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-e06024b4-3eec-4217-8099-5aa4e33535d5 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:27.250514 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-e06024b4-3eec-4217-8099-5aa4e33535d5 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:27.251786 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-e06024b4-3eec-4217-8099-5aa4e33535d5 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1809 microversion: 2.20 time: 0.152982 Mar 31 18:19:27.252332 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 250/512] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:19:27 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 31 18:19:27.667620 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-0a407701-c366-4f70-9fe0-d28bcc29e7e1 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:27.668443 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-0a407701-c366-4f70-9fe0-d28bcc29e7e1 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:27.674248 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0a407701-c366-4f70-9fe0-d28bcc29e7e1 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:27.674744 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0a407701-c366-4f70-9fe0-d28bcc29e7e1 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:27.675483 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0a407701-c366-4f70-9fe0-d28bcc29e7e1 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:27.675907 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0a407701-c366-4f70-9fe0-d28bcc29e7e1 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:27.814394 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-0a407701-c366-4f70-9fe0-d28bcc29e7e1 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:27.821651 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-0a407701-c366-4f70-9fe0-d28bcc29e7e1 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1259 microversion: 2.1 time: 0.158464 Mar 31 18:19:27.822205 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 251/513] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:27 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:19:28.270906 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-26358e31-a82a-4167-94f0-6bfaf77d0272 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:28.271528 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-26358e31-a82a-4167-94f0-6bfaf77d0272 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:28.277550 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-26358e31-a82a-4167-94f0-6bfaf77d0272 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:28.277994 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-26358e31-a82a-4167-94f0-6bfaf77d0272 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:28.278801 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-26358e31-a82a-4167-94f0-6bfaf77d0272 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:28.279230 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-26358e31-a82a-4167-94f0-6bfaf77d0272 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:28.408956 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-26358e31-a82a-4167-94f0-6bfaf77d0272 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:28.417797 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-26358e31-a82a-4167-94f0-6bfaf77d0272 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:28.419358 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-26358e31-a82a-4167-94f0-6bfaf77d0272 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:28.420504 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-26358e31-a82a-4167-94f0-6bfaf77d0272 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1809 microversion: 2.20 time: 0.153433 Mar 31 18:19:28.421062 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 252/514] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:19:28 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 31 18:19:28.837754 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-a57d6b55-5ca8-45cd-8c0e-e9e7df9969f2 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:28.838353 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-a57d6b55-5ca8-45cd-8c0e-e9e7df9969f2 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:28.844639 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a57d6b55-5ca8-45cd-8c0e-e9e7df9969f2 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:28.845074 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a57d6b55-5ca8-45cd-8c0e-e9e7df9969f2 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:28.845817 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a57d6b55-5ca8-45cd-8c0e-e9e7df9969f2 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:28.846235 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a57d6b55-5ca8-45cd-8c0e-e9e7df9969f2 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:28.981481 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-a57d6b55-5ca8-45cd-8c0e-e9e7df9969f2 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:28.988904 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-a57d6b55-5ca8-45cd-8c0e-e9e7df9969f2 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1259 microversion: 2.1 time: 0.154925 Mar 31 18:19:28.989512 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 253/515] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:28 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:19:29.438871 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-2a004ddd-04e5-4486-9046-07373fda60ad tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:29.439572 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-2a004ddd-04e5-4486-9046-07373fda60ad tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:29.445342 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-2a004ddd-04e5-4486-9046-07373fda60ad tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:29.448975 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-2a004ddd-04e5-4486-9046-07373fda60ad tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:29.448975 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-2a004ddd-04e5-4486-9046-07373fda60ad tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:29.448975 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-2a004ddd-04e5-4486-9046-07373fda60ad tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:29.580031 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-2a004ddd-04e5-4486-9046-07373fda60ad tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:29.588422 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-2a004ddd-04e5-4486-9046-07373fda60ad tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:29.590744 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-2a004ddd-04e5-4486-9046-07373fda60ad tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:29.591883 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-2a004ddd-04e5-4486-9046-07373fda60ad tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1809 microversion: 2.20 time: 0.157161 Mar 31 18:19:29.592449 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 254/516] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:19:29 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 31 18:19:29.670904 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-328818c6-9eb1-4847-a7b8-ba5aa163da71 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "POST /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.917092 Mar 31 18:19:29.671792 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 263/517] 10.222.0.58 () {60 vars in 1322 bytes} [Thu Mar 31 18:19:23 2022] POST /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88/os-volume_attachments => generated 194 bytes in 5919 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:19:30.005490 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-fab1e6c9-7611-4d74-9748-09f112bb8b3d tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:30.006119 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-fab1e6c9-7611-4d74-9748-09f112bb8b3d tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:30.013140 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-fab1e6c9-7611-4d74-9748-09f112bb8b3d tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:30.013580 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-fab1e6c9-7611-4d74-9748-09f112bb8b3d tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:30.014369 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-fab1e6c9-7611-4d74-9748-09f112bb8b3d tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:30.014799 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-fab1e6c9-7611-4d74-9748-09f112bb8b3d tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:30.147332 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-fab1e6c9-7611-4d74-9748-09f112bb8b3d tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:30.154391 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-fab1e6c9-7611-4d74-9748-09f112bb8b3d tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1259 microversion: 2.1 time: 0.152980 Mar 31 18:19:30.166594 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 255/518] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:30 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1259 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:19:30.611693 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-221b1f68-804c-41df-b31d-956f86767fc8 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:30.612329 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-221b1f68-804c-41df-b31d-956f86767fc8 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:30.618366 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-221b1f68-804c-41df-b31d-956f86767fc8 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:30.618902 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-221b1f68-804c-41df-b31d-956f86767fc8 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:30.619655 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-221b1f68-804c-41df-b31d-956f86767fc8 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:30.620746 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-221b1f68-804c-41df-b31d-956f86767fc8 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:30.755449 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-221b1f68-804c-41df-b31d-956f86767fc8 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:30.764197 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-221b1f68-804c-41df-b31d-956f86767fc8 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:30.765695 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-221b1f68-804c-41df-b31d-956f86767fc8 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:30.766874 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-221b1f68-804c-41df-b31d-956f86767fc8 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1809 microversion: 2.20 time: 0.159924 Mar 31 18:19:30.767420 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 264/519] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:19:30 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:19:31.170400 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-fe9dee6e-b14a-4318-b507-c85120212028 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:31.171035 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-fe9dee6e-b14a-4318-b507-c85120212028 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:31.176917 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-fe9dee6e-b14a-4318-b507-c85120212028 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:31.177352 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-fe9dee6e-b14a-4318-b507-c85120212028 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:31.178101 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-fe9dee6e-b14a-4318-b507-c85120212028 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:31.178528 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-fe9dee6e-b14a-4318-b507-c85120212028 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:31.320313 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-fe9dee6e-b14a-4318-b507-c85120212028 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:31.325773 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-fe9dee6e-b14a-4318-b507-c85120212028 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1259 microversion: 2.1 time: 0.159576 Mar 31 18:19:31.326345 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 256/520] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:31 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:19:31.788207 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-ae788b49-fab7-4dfa-b001-ea333e25908e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:31.788812 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-ae788b49-fab7-4dfa-b001-ea333e25908e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:31.795864 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-ae788b49-fab7-4dfa-b001-ea333e25908e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:31.796305 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-ae788b49-fab7-4dfa-b001-ea333e25908e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:31.797068 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-ae788b49-fab7-4dfa-b001-ea333e25908e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:31.797495 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-ae788b49-fab7-4dfa-b001-ea333e25908e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:31.933592 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-ae788b49-fab7-4dfa-b001-ea333e25908e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:31.941728 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-ae788b49-fab7-4dfa-b001-ea333e25908e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:31.943301 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-ae788b49-fab7-4dfa-b001-ea333e25908e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:31.944504 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-ae788b49-fab7-4dfa-b001-ea333e25908e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1809 microversion: 2.20 time: 0.160194 Mar 31 18:19:31.945058 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 265/521] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:19:31 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:19:32.342300 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-84848a0a-ea10-483b-b99c-093deb5a7379 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:32.342970 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-84848a0a-ea10-483b-b99c-093deb5a7379 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:32.348655 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-84848a0a-ea10-483b-b99c-093deb5a7379 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:32.349085 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-84848a0a-ea10-483b-b99c-093deb5a7379 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:32.349888 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-84848a0a-ea10-483b-b99c-093deb5a7379 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:32.350346 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-84848a0a-ea10-483b-b99c-093deb5a7379 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:32.484969 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-84848a0a-ea10-483b-b99c-093deb5a7379 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:32.492203 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-84848a0a-ea10-483b-b99c-093deb5a7379 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1259 microversion: 2.1 time: 0.154245 Mar 31 18:19:32.492756 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 257/522] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:32 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:19:32.963364 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-67f64596-9109-43de-be20-84320391c883 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:32.964724 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-67f64596-9109-43de-be20-84320391c883 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:32.970877 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-67f64596-9109-43de-be20-84320391c883 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:32.971323 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-67f64596-9109-43de-be20-84320391c883 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:32.972085 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-67f64596-9109-43de-be20-84320391c883 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:32.972512 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-67f64596-9109-43de-be20-84320391c883 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:33.104869 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-67f64596-9109-43de-be20-84320391c883 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:33.112992 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-67f64596-9109-43de-be20-84320391c883 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:33.114531 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-67f64596-9109-43de-be20-84320391c883 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:33.120442 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-67f64596-9109-43de-be20-84320391c883 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1809 microversion: 2.20 time: 0.156400 Mar 31 18:19:33.120442 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 266/523] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:19:32 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:19:33.508276 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-eec3cb11-1fb0-4f3e-8c6c-b39070072572 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:33.508971 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-eec3cb11-1fb0-4f3e-8c6c-b39070072572 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:33.515328 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-eec3cb11-1fb0-4f3e-8c6c-b39070072572 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:33.515841 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-eec3cb11-1fb0-4f3e-8c6c-b39070072572 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:33.516675 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-eec3cb11-1fb0-4f3e-8c6c-b39070072572 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:33.517184 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-eec3cb11-1fb0-4f3e-8c6c-b39070072572 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:33.545413 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-69e7acc0-b987-4f97-b95c-7352a19739e2 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-2009612647", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-270850616", "security_groups": [{"name": "tempest-secgroup-smoke-532749938"}], "block_device_mapping_v2": [{"uuid": "4f06148f-c3da-48e9-b5d5-ed1f835ff060", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "46cf5202-8790-480a-a14a-b087639c31e2"}]}} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:19:33.657337 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-eec3cb11-1fb0-4f3e-8c6c-b39070072572 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:33.664632 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-eec3cb11-1fb0-4f3e-8c6c-b39070072572 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1259 microversion: 2.1 time: 0.160083 Mar 31 18:19:33.665474 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 258/524] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:33 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1259 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:19:33.672723 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.network.neutron [None req-69e7acc0-b987-4f97-b95c-7352a19739e2 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] validate_networks() for [('46cf5202-8790-480a-a14a-b087639c31e2', None, None, None, None, None)] {{(pid=117538) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 31 18:19:34.064813 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.virt.hardware [None req-69e7acc0-b987-4f97-b95c-7352a19739e2 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Flavor limits 0:0:0 {{(pid=117538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 31 18:19:34.065294 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.virt.hardware [None req-69e7acc0-b987-4f97-b95c-7352a19739e2 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Image limits 0:0:0 {{(pid=117538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 31 18:19:34.065743 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.virt.hardware [None req-69e7acc0-b987-4f97-b95c-7352a19739e2 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Flavor pref 0:0:0 {{(pid=117538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 31 18:19:34.066194 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.virt.hardware [None req-69e7acc0-b987-4f97-b95c-7352a19739e2 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Image pref 0:0:0 {{(pid=117538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 31 18:19:34.066642 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.virt.hardware [None req-69e7acc0-b987-4f97-b95c-7352a19739e2 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 31 18:19:34.075276 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-69e7acc0-b987-4f97-b95c-7352a19739e2 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:34.075716 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-69e7acc0-b987-4f97-b95c-7352a19739e2 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:34.076511 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-69e7acc0-b987-4f97-b95c-7352a19739e2 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:34.076937 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-69e7acc0-b987-4f97-b95c-7352a19739e2 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:34.093462 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.quota [None req-69e7acc0-b987-4f97-b95c-7352a19739e2 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Getting quotas for project 70f0b3390f4542c8831753ecf26f6745. Resources: {'instances', 'ram', 'cores'} {{(pid=117538) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 31 18:19:34.097246 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.quota [None req-69e7acc0-b987-4f97-b95c-7352a19739e2 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Getting quotas for user 7c5ea90eba174068877cdcc1594ccda4 and project 70f0b3390f4542c8831753ecf26f6745. Resources: {'instances', 'ram', 'cores'} {{(pid=117538) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 31 18:19:34.134825 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-54b5c6b0-4018-4ff6-b015-30bca873ed5d tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:34.135505 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-54b5c6b0-4018-4ff6-b015-30bca873ed5d tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:34.141789 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-54b5c6b0-4018-4ff6-b015-30bca873ed5d tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:34.142272 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-54b5c6b0-4018-4ff6-b015-30bca873ed5d tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:34.143155 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-54b5c6b0-4018-4ff6-b015-30bca873ed5d tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:34.143575 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-54b5c6b0-4018-4ff6-b015-30bca873ed5d tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:34.161438 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-69e7acc0-b987-4f97-b95c-7352a19739e2 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Going to run 1 instances... {{(pid=117538) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 31 18:19:34.164072 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-69e7acc0-b987-4f97-b95c-7352a19739e2 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: 06c9b67d-f63b-4be1-ab26-18346902f6e3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4f06148f-c3da-48e9-b5d5-ed1f835ff060',volume_size=None,volume_type=None)] {{(pid=117538) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 31 18:19:34.279198 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-54b5c6b0-4018-4ff6-b015-30bca873ed5d tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:34.287503 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-54b5c6b0-4018-4ff6-b015-30bca873ed5d tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:34.289195 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-54b5c6b0-4018-4ff6-b015-30bca873ed5d tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:34.290348 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-54b5c6b0-4018-4ff6-b015-30bca873ed5d tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1809 microversion: 2.20 time: 0.159871 Mar 31 18:19:34.290926 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 259/525] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:19:34 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 31 18:19:34.605117 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-69e7acc0-b987-4f97-b95c-7352a19739e2 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.064637 Mar 31 18:19:34.605785 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 267/526] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Mar 31 18:19:33 2022] POST /compute/v2.1/servers => generated 405 bytes in 1066 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 31 18:19:34.616111 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-5edc5a36-34e5-4be4-88a0-cc0c83d719cc tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:34.616824 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-5edc5a36-34e5-4be4-88a0-cc0c83d719cc tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: 06c9b67d-f63b-4be1-ab26-18346902f6e3] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:34.670090 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-5edc5a36-34e5-4be4-88a0-cc0c83d719cc tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:34.676500 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-5edc5a36-34e5-4be4-88a0-cc0c83d719cc tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/06c9b67d-f63b-4be1-ab26-18346902f6e3" status: 200 len: 1094 microversion: 2.1 time: 0.063971 Mar 31 18:19:34.677233 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 260/527] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:34 2022] GET /compute/v2.1/servers/06c9b67d-f63b-4be1-ab26-18346902f6e3 => generated 1094 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:19:34.681230 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-72886eb2-607c-4190-9af3-ebfeffc5e674 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:34.681844 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-72886eb2-607c-4190-9af3-ebfeffc5e674 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:34.688466 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-72886eb2-607c-4190-9af3-ebfeffc5e674 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:34.688907 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-72886eb2-607c-4190-9af3-ebfeffc5e674 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:34.689757 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-72886eb2-607c-4190-9af3-ebfeffc5e674 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:34.690272 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-72886eb2-607c-4190-9af3-ebfeffc5e674 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:34.829583 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-72886eb2-607c-4190-9af3-ebfeffc5e674 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:34.836771 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-72886eb2-607c-4190-9af3-ebfeffc5e674 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1259 microversion: 2.1 time: 0.159473 Mar 31 18:19:34.837333 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 268/528] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:34 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:19:35.317959 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-7135498b-d41c-4437-9bb8-47f8e316af56 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:35.318472 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-7135498b-d41c-4437-9bb8-47f8e316af56 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:35.325027 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-7135498b-d41c-4437-9bb8-47f8e316af56 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:35.325463 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-7135498b-d41c-4437-9bb8-47f8e316af56 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:35.326206 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-7135498b-d41c-4437-9bb8-47f8e316af56 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:35.326699 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-7135498b-d41c-4437-9bb8-47f8e316af56 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:35.461127 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-7135498b-d41c-4437-9bb8-47f8e316af56 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:35.469206 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-7135498b-d41c-4437-9bb8-47f8e316af56 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:35.470780 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-7135498b-d41c-4437-9bb8-47f8e316af56 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:35.471898 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-7135498b-d41c-4437-9bb8-47f8e316af56 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1809 microversion: 2.20 time: 0.158105 Mar 31 18:19:35.472451 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 261/529] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:19:35 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:19:35.692338 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-60cbeb28-7e3c-44f1-8012-4086e7f0c922 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:35.692877 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-60cbeb28-7e3c-44f1-8012-4086e7f0c922 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: 06c9b67d-f63b-4be1-ab26-18346902f6e3] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:35.699204 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-60cbeb28-7e3c-44f1-8012-4086e7f0c922 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:35.699649 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-60cbeb28-7e3c-44f1-8012-4086e7f0c922 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:35.700459 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-60cbeb28-7e3c-44f1-8012-4086e7f0c922 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:35.700896 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-60cbeb28-7e3c-44f1-8012-4086e7f0c922 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:35.762362 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-60cbeb28-7e3c-44f1-8012-4086e7f0c922 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:35.769574 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-60cbeb28-7e3c-44f1-8012-4086e7f0c922 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/06c9b67d-f63b-4be1-ab26-18346902f6e3" status: 200 len: 1144 microversion: 2.1 time: 0.081172 Mar 31 18:19:35.770133 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 269/530] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:35 2022] GET /compute/v2.1/servers/06c9b67d-f63b-4be1-ab26-18346902f6e3 => generated 1144 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:19:35.853368 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-5599fe8f-2b89-4f64-ae5f-fb75df99064e tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:35.854155 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-5599fe8f-2b89-4f64-ae5f-fb75df99064e tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:35.860713 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-5599fe8f-2b89-4f64-ae5f-fb75df99064e tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:35.861161 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-5599fe8f-2b89-4f64-ae5f-fb75df99064e tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:35.861999 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-5599fe8f-2b89-4f64-ae5f-fb75df99064e tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:35.862431 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-5599fe8f-2b89-4f64-ae5f-fb75df99064e tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:36.000951 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-5599fe8f-2b89-4f64-ae5f-fb75df99064e tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:36.008531 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-5599fe8f-2b89-4f64-ae5f-fb75df99064e tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1259 microversion: 2.1 time: 0.159162 Mar 31 18:19:36.009310 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 262/531] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:35 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:19:36.491767 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-4895383d-a02c-45d5-9f59-ddfd4dd6542b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:36.492874 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-4895383d-a02c-45d5-9f59-ddfd4dd6542b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:36.499696 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4895383d-a02c-45d5-9f59-ddfd4dd6542b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:36.500174 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4895383d-a02c-45d5-9f59-ddfd4dd6542b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:36.501195 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4895383d-a02c-45d5-9f59-ddfd4dd6542b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:36.501977 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4895383d-a02c-45d5-9f59-ddfd4dd6542b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:36.639006 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-4895383d-a02c-45d5-9f59-ddfd4dd6542b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:36.647344 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-4895383d-a02c-45d5-9f59-ddfd4dd6542b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:36.648846 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-4895383d-a02c-45d5-9f59-ddfd4dd6542b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:36.649992 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-4895383d-a02c-45d5-9f59-ddfd4dd6542b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1809 microversion: 2.20 time: 0.163196 Mar 31 18:19:36.650594 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 270/532] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:19:36 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:19:36.787028 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-b04908f4-787a-43aa-b63b-930cfc9843aa tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:36.787626 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-b04908f4-787a-43aa-b63b-930cfc9843aa tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: 06c9b67d-f63b-4be1-ab26-18346902f6e3] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:36.793564 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b04908f4-787a-43aa-b63b-930cfc9843aa tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:36.793993 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b04908f4-787a-43aa-b63b-930cfc9843aa tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:36.794840 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b04908f4-787a-43aa-b63b-930cfc9843aa tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:36.795266 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b04908f4-787a-43aa-b63b-930cfc9843aa tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:36.854787 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-b04908f4-787a-43aa-b63b-930cfc9843aa tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:36.862266 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-b04908f4-787a-43aa-b63b-930cfc9843aa tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/06c9b67d-f63b-4be1-ab26-18346902f6e3" status: 200 len: 1192 microversion: 2.1 time: 0.079154 Mar 31 18:19:36.862860 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 263/533] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:36 2022] GET /compute/v2.1/servers/06c9b67d-f63b-4be1-ab26-18346902f6e3 => generated 1192 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:19:37.025235 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-4f051f8a-e5fd-4d66-9701-3edd2974fe67 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:37.025900 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-4f051f8a-e5fd-4d66-9701-3edd2974fe67 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:37.032506 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4f051f8a-e5fd-4d66-9701-3edd2974fe67 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:37.032952 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4f051f8a-e5fd-4d66-9701-3edd2974fe67 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:37.040084 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4f051f8a-e5fd-4d66-9701-3edd2974fe67 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:37.040680 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4f051f8a-e5fd-4d66-9701-3edd2974fe67 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:37.306304 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-4f051f8a-e5fd-4d66-9701-3edd2974fe67 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:37.313607 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-4f051f8a-e5fd-4d66-9701-3edd2974fe67 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1259 microversion: 2.1 time: 0.292246 Mar 31 18:19:37.314167 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 271/534] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:37 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1259 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:19:37.668502 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-36e462af-9a82-4b65-bc14-36c479ed736a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:37.669102 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-36e462af-9a82-4b65-bc14-36c479ed736a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:37.674960 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-36e462af-9a82-4b65-bc14-36c479ed736a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:37.675403 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-36e462af-9a82-4b65-bc14-36c479ed736a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:37.676165 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-36e462af-9a82-4b65-bc14-36c479ed736a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:37.676591 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-36e462af-9a82-4b65-bc14-36c479ed736a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:37.821770 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-36e462af-9a82-4b65-bc14-36c479ed736a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:37.839827 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-36e462af-9a82-4b65-bc14-36c479ed736a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:37.839827 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-36e462af-9a82-4b65-bc14-36c479ed736a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:37.839827 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-36e462af-9a82-4b65-bc14-36c479ed736a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1809 microversion: 2.20 time: 0.170672 Mar 31 18:19:37.840290 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 264/535] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:19:37 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1809 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:19:37.884839 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-fa82a24a-b8eb-4c0b-ae9b-2c544d618cba tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:37.886792 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-fa82a24a-b8eb-4c0b-ae9b-2c544d618cba tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: 06c9b67d-f63b-4be1-ab26-18346902f6e3] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:37.893653 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-fa82a24a-b8eb-4c0b-ae9b-2c544d618cba tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:37.895545 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-fa82a24a-b8eb-4c0b-ae9b-2c544d618cba tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:37.896627 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-fa82a24a-b8eb-4c0b-ae9b-2c544d618cba tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:37.897128 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-fa82a24a-b8eb-4c0b-ae9b-2c544d618cba tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:38.084491 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-fa82a24a-b8eb-4c0b-ae9b-2c544d618cba tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:38.093928 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-fa82a24a-b8eb-4c0b-ae9b-2c544d618cba tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/06c9b67d-f63b-4be1-ab26-18346902f6e3" status: 200 len: 1277 microversion: 2.1 time: 0.217409 Mar 31 18:19:38.095714 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 272/536] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:37 2022] GET /compute/v2.1/servers/06c9b67d-f63b-4be1-ab26-18346902f6e3 => generated 1277 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:19:38.249717 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-c5d3ce18-7897-4128-964e-c5424ae4b00f tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:19:38.250784 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-c5d3ce18-7897-4128-964e-c5424ae4b00f tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: a2498a53-f6d8-4236-8788-289622fc2c88] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:38.256760 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c5d3ce18-7897-4128-964e-c5424ae4b00f tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:38.257246 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c5d3ce18-7897-4128-964e-c5424ae4b00f tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:38.258019 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c5d3ce18-7897-4128-964e-c5424ae4b00f tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:38.258453 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c5d3ce18-7897-4128-964e-c5424ae4b00f tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:38.282564 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.objects.instance [None req-c5d3ce18-7897-4128-964e-c5424ae4b00f tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lazy-loading 'flavor' on Instance uuid a2498a53-f6d8-4236-8788-289622fc2c88 {{(pid=117539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 31 18:19:38.330408 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-4b18e4cc-b7dd-41b9-9c02-e31ccd50737e tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:38.331054 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-4b18e4cc-b7dd-41b9-9c02-e31ccd50737e tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:38.336846 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4b18e4cc-b7dd-41b9-9c02-e31ccd50737e tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:38.337310 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4b18e4cc-b7dd-41b9-9c02-e31ccd50737e tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:38.338111 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4b18e4cc-b7dd-41b9-9c02-e31ccd50737e tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:38.338792 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4b18e4cc-b7dd-41b9-9c02-e31ccd50737e tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:38.523808 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-4b18e4cc-b7dd-41b9-9c02-e31ccd50737e tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:38.531635 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-4b18e4cc-b7dd-41b9-9c02-e31ccd50737e tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1259 microversion: 2.1 time: 0.205053 Mar 31 18:19:38.532166 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 273/537] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:38 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1259 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:19:38.706184 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-c5d3ce18-7897-4128-964e-c5424ae4b00f tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "POST /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88/action" status: 200 len: 32 microversion: 2.1 time: 0.462804 Mar 31 18:19:38.711115 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 265/538] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Mar 31 18:19:38 2022] POST /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88/action => generated 32 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 31 18:19:38.717422 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-fc00ce02-a067-46ae-b508-a9a247ecae6e tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:38.718032 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-fc00ce02-a067-46ae-b508-a9a247ecae6e tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: a2498a53-f6d8-4236-8788-289622fc2c88] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:38.732680 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-fc00ce02-a067-46ae-b508-a9a247ecae6e tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:38.732680 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-fc00ce02-a067-46ae-b508-a9a247ecae6e tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:38.732680 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-fc00ce02-a067-46ae-b508-a9a247ecae6e tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:38.732680 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-fc00ce02-a067-46ae-b508-a9a247ecae6e tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:38.858484 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-3bc0f622-9f28-4e1d-acdf-60448aa395f6 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:38.859203 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-3bc0f622-9f28-4e1d-acdf-60448aa395f6 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:38.866371 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3bc0f622-9f28-4e1d-acdf-60448aa395f6 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:38.867017 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3bc0f622-9f28-4e1d-acdf-60448aa395f6 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:38.867776 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3bc0f622-9f28-4e1d-acdf-60448aa395f6 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:38.868200 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3bc0f622-9f28-4e1d-acdf-60448aa395f6 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:38.971881 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-fc00ce02-a067-46ae-b508-a9a247ecae6e tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:38.986407 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-fc00ce02-a067-46ae-b508-a9a247ecae6e tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88" status: 200 len: 1734 microversion: 2.1 time: 0.273500 Mar 31 18:19:38.988278 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 274/539] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:38 2022] GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88 => generated 1734 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:19:38.995477 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [req-58cb0c02-3b55-442e-804b-d502dce68cda req-7d409425-59dc-4efa-ae7a-aeb108a9ff01 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06c9b67d-f63b-4be1-ab26-18346902f6e3", "tag": "d73baa13-9b78-4d3b-b347-b15a781aadbe"}]} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:19:39.013938 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-58cb0c02-3b55-442e-804b-d502dce68cda req-7d409425-59dc-4efa-ae7a-aeb108a9ff01 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:39.024345 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-58cb0c02-3b55-442e-804b-d502dce68cda req-7d409425-59dc-4efa-ae7a-aeb108a9ff01 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:39.046058 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-3bc0f622-9f28-4e1d-acdf-60448aa395f6 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:39.047706 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.compute.server_external_events [req-58cb0c02-3b55-442e-804b-d502dce68cda req-7d409425-59dc-4efa-ae7a-aeb108a9ff01 service nova] Creating event network-changed:d73baa13-9b78-4d3b-b347-b15a781aadbe for instance 06c9b67d-f63b-4be1-ab26-18346902f6e3 on hv-cinder-maste Mar 31 18:19:39.058043 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [req-58cb0c02-3b55-442e-804b-d502dce68cda req-7d409425-59dc-4efa-ae7a-aeb108a9ff01 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065995 Mar 31 18:19:39.062172 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 275/540] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:19:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:19:39.069533 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-3bc0f622-9f28-4e1d-acdf-60448aa395f6 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:39.071325 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-3bc0f622-9f28-4e1d-acdf-60448aa395f6 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:39.073858 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-3bc0f622-9f28-4e1d-acdf-60448aa395f6 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1809 microversion: 2.20 time: 0.222186 Mar 31 18:19:39.075071 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 266/541] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:19:38 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1809 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:19:39.111998 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-bd325d50-5d4a-48c5-840f-f3c4a2e1806c tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:39.113254 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-bd325d50-5d4a-48c5-840f-f3c4a2e1806c tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: 06c9b67d-f63b-4be1-ab26-18346902f6e3] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:39.125333 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-bd325d50-5d4a-48c5-840f-f3c4a2e1806c tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:39.125807 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-bd325d50-5d4a-48c5-840f-f3c4a2e1806c tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:39.127051 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-bd325d50-5d4a-48c5-840f-f3c4a2e1806c tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:39.127498 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-bd325d50-5d4a-48c5-840f-f3c4a2e1806c tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:39.466451 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-bd325d50-5d4a-48c5-840f-f3c4a2e1806c tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:39.473674 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-bd325d50-5d4a-48c5-840f-f3c4a2e1806c tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/06c9b67d-f63b-4be1-ab26-18346902f6e3" status: 200 len: 1277 microversion: 2.1 time: 0.365920 Mar 31 18:19:39.474250 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 276/542] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:39 2022] GET /compute/v2.1/servers/06c9b67d-f63b-4be1-ab26-18346902f6e3 => generated 1277 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:19:39.548412 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-ab4144f8-9fe4-4d7c-bfa1-364472ae6438 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:39.549132 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-ab4144f8-9fe4-4d7c-bfa1-364472ae6438 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:39.555045 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ab4144f8-9fe4-4d7c-bfa1-364472ae6438 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:39.555491 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ab4144f8-9fe4-4d7c-bfa1-364472ae6438 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:39.556530 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ab4144f8-9fe4-4d7c-bfa1-364472ae6438 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:39.557533 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ab4144f8-9fe4-4d7c-bfa1-364472ae6438 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:39.703801 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-ab4144f8-9fe4-4d7c-bfa1-364472ae6438 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:39.713393 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-ab4144f8-9fe4-4d7c-bfa1-364472ae6438 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1259 microversion: 2.1 time: 0.168655 Mar 31 18:19:39.714441 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 267/543] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:39 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1259 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:19:40.005603 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-c1e37710-8719-4101-807b-6f936d7cf779 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:40.006404 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-c1e37710-8719-4101-807b-6f936d7cf779 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: a2498a53-f6d8-4236-8788-289622fc2c88] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:40.013773 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c1e37710-8719-4101-807b-6f936d7cf779 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:40.014410 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c1e37710-8719-4101-807b-6f936d7cf779 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:40.015374 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c1e37710-8719-4101-807b-6f936d7cf779 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:40.015803 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c1e37710-8719-4101-807b-6f936d7cf779 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:40.093343 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-ed889162-05d6-40d8-a631-a0b55c527605 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:40.093951 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-ed889162-05d6-40d8-a631-a0b55c527605 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:40.101121 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ed889162-05d6-40d8-a631-a0b55c527605 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:40.101121 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ed889162-05d6-40d8-a631-a0b55c527605 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:40.101429 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ed889162-05d6-40d8-a631-a0b55c527605 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:40.101958 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ed889162-05d6-40d8-a631-a0b55c527605 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:40.263975 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-ed889162-05d6-40d8-a631-a0b55c527605 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:40.267317 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-c1e37710-8719-4101-807b-6f936d7cf779 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:40.272976 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-ed889162-05d6-40d8-a631-a0b55c527605 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:40.274461 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-ed889162-05d6-40d8-a631-a0b55c527605 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:40.275421 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-c1e37710-8719-4101-807b-6f936d7cf779 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88" status: 200 len: 1734 microversion: 2.1 time: 0.273924 Mar 31 18:19:40.276280 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-ed889162-05d6-40d8-a631-a0b55c527605 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1809 microversion: 2.20 time: 0.186466 Mar 31 18:19:40.276614 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 277/544] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:40 2022] GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88 => generated 1734 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:19:40.276977 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 268/545] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:19:40 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1809 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 31 18:19:40.490935 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-d383d4eb-ed7b-418c-b4d0-b7a0fef17411 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:40.491572 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-d383d4eb-ed7b-418c-b4d0-b7a0fef17411 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: 06c9b67d-f63b-4be1-ab26-18346902f6e3] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:40.497941 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-d383d4eb-ed7b-418c-b4d0-b7a0fef17411 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:40.498387 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-d383d4eb-ed7b-418c-b4d0-b7a0fef17411 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:40.499186 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-d383d4eb-ed7b-418c-b4d0-b7a0fef17411 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:40.499617 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-d383d4eb-ed7b-418c-b4d0-b7a0fef17411 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:40.641875 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-d383d4eb-ed7b-418c-b4d0-b7a0fef17411 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:40.649087 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-d383d4eb-ed7b-418c-b4d0-b7a0fef17411 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/06c9b67d-f63b-4be1-ab26-18346902f6e3" status: 200 len: 1265 microversion: 2.1 time: 0.162195 Mar 31 18:19:40.649644 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 278/546] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:40 2022] GET /compute/v2.1/servers/06c9b67d-f63b-4be1-ab26-18346902f6e3 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:19:40.730910 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-b8036224-5319-42c5-86b1-c34343ace01f tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:40.731568 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-b8036224-5319-42c5-86b1-c34343ace01f tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:40.737573 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b8036224-5319-42c5-86b1-c34343ace01f tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:40.738043 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b8036224-5319-42c5-86b1-c34343ace01f tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:40.738844 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b8036224-5319-42c5-86b1-c34343ace01f tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:40.739277 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b8036224-5319-42c5-86b1-c34343ace01f tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:40.890060 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-b8036224-5319-42c5-86b1-c34343ace01f tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:40.897684 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-b8036224-5319-42c5-86b1-c34343ace01f tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1259 microversion: 2.1 time: 0.170910 Mar 31 18:19:40.898349 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 269/547] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:40 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1259 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:19:41.294008 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-4d2b33b9-dbae-4296-8ac3-500a7cc33359 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:41.294534 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-838bef6d-f650-4031-a6d5-d38a95416d00 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:41.294656 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-4d2b33b9-dbae-4296-8ac3-500a7cc33359 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: a2498a53-f6d8-4236-8788-289622fc2c88] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:41.295143 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-838bef6d-f650-4031-a6d5-d38a95416d00 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:41.300965 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4d2b33b9-dbae-4296-8ac3-500a7cc33359 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:41.301114 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-838bef6d-f650-4031-a6d5-d38a95416d00 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:41.301409 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4d2b33b9-dbae-4296-8ac3-500a7cc33359 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:41.301535 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-838bef6d-f650-4031-a6d5-d38a95416d00 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:41.302235 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4d2b33b9-dbae-4296-8ac3-500a7cc33359 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:41.302347 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-838bef6d-f650-4031-a6d5-d38a95416d00 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:41.302687 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-838bef6d-f650-4031-a6d5-d38a95416d00 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:41.302792 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4d2b33b9-dbae-4296-8ac3-500a7cc33359 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:41.435467 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-4d2b33b9-dbae-4296-8ac3-500a7cc33359 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:41.435715 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-838bef6d-f650-4031-a6d5-d38a95416d00 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:41.443271 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-4d2b33b9-dbae-4296-8ac3-500a7cc33359 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88" status: 200 len: 1734 microversion: 2.1 time: 0.154063 Mar 31 18:19:41.443838 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 279/548] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:41 2022] GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:19:41.444051 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-838bef6d-f650-4031-a6d5-d38a95416d00 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:41.445622 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-838bef6d-f650-4031-a6d5-d38a95416d00 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:41.446974 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-838bef6d-f650-4031-a6d5-d38a95416d00 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1809 microversion: 2.20 time: 0.157055 Mar 31 18:19:41.448160 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 270/549] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:19:41 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 31 18:19:41.667010 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-6d9ac92d-e20a-48f5-8124-a22583a26497 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:41.667547 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-6d9ac92d-e20a-48f5-8124-a22583a26497 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: 06c9b67d-f63b-4be1-ab26-18346902f6e3] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:41.673432 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6d9ac92d-e20a-48f5-8124-a22583a26497 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:41.673873 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6d9ac92d-e20a-48f5-8124-a22583a26497 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:41.674646 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6d9ac92d-e20a-48f5-8124-a22583a26497 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:41.675083 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6d9ac92d-e20a-48f5-8124-a22583a26497 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:41.811299 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-6d9ac92d-e20a-48f5-8124-a22583a26497 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:41.818512 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-6d9ac92d-e20a-48f5-8124-a22583a26497 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/06c9b67d-f63b-4be1-ab26-18346902f6e3" status: 200 len: 1265 microversion: 2.1 time: 0.155634 Mar 31 18:19:41.819110 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 280/550] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:41 2022] GET /compute/v2.1/servers/06c9b67d-f63b-4be1-ab26-18346902f6e3 => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:19:41.914925 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-9b8bb2fb-cd32-46c4-8a6d-02cfb72c0d3b tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:41.915527 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-9b8bb2fb-cd32-46c4-8a6d-02cfb72c0d3b tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:41.921494 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9b8bb2fb-cd32-46c4-8a6d-02cfb72c0d3b tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:41.921859 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9b8bb2fb-cd32-46c4-8a6d-02cfb72c0d3b tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:41.922603 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9b8bb2fb-cd32-46c4-8a6d-02cfb72c0d3b tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:41.923052 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9b8bb2fb-cd32-46c4-8a6d-02cfb72c0d3b tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:42.059980 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-9b8bb2fb-cd32-46c4-8a6d-02cfb72c0d3b tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:42.067361 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-9b8bb2fb-cd32-46c4-8a6d-02cfb72c0d3b tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1259 microversion: 2.1 time: 0.156356 Mar 31 18:19:42.067919 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 271/551] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:41 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:19:42.280403 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [req-85afb029-41a6-42de-bc38-d3dd973882d9 req-d00c419a-772b-4604-82e0-2003351eda4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61abeff2-268a-4149-9962-497c409663ed", "name": "network-vif-plugged", "status": "completed", "tag": "156f9ff9-ec0d-4ac3-a7d7-2fa14dbead9a"}]} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:19:42.288670 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-85afb029-41a6-42de-bc38-d3dd973882d9 req-d00c419a-772b-4604-82e0-2003351eda4b service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:42.289113 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-85afb029-41a6-42de-bc38-d3dd973882d9 req-d00c419a-772b-4604-82e0-2003351eda4b service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:42.301048 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.compute.server_external_events [req-85afb029-41a6-42de-bc38-d3dd973882d9 req-d00c419a-772b-4604-82e0-2003351eda4b service nova] Creating event network-vif-plugged:156f9ff9-ec0d-4ac3-a7d7-2fa14dbead9a for instance 61abeff2-268a-4149-9962-497c409663ed on hv-cinder-maste Mar 31 18:19:42.306075 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [req-85afb029-41a6-42de-bc38-d3dd973882d9 req-d00c419a-772b-4604-82e0-2003351eda4b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084944 Mar 31 18:19:42.306735 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 281/552] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:19:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:19:42.460884 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-27827b76-1cbd-4531-8d99-5d20f582b942 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:42.461406 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-27827b76-1cbd-4531-8d99-5d20f582b942 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: a2498a53-f6d8-4236-8788-289622fc2c88] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:42.465848 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-f6234e34-1bef-48af-8ab2-a1c66fa72bb6 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:42.466577 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-f6234e34-1bef-48af-8ab2-a1c66fa72bb6 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:42.467330 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-27827b76-1cbd-4531-8d99-5d20f582b942 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:42.467769 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-27827b76-1cbd-4531-8d99-5d20f582b942 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:42.468561 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-27827b76-1cbd-4531-8d99-5d20f582b942 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:42.468990 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-27827b76-1cbd-4531-8d99-5d20f582b942 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:42.473411 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f6234e34-1bef-48af-8ab2-a1c66fa72bb6 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:42.473863 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f6234e34-1bef-48af-8ab2-a1c66fa72bb6 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:42.474672 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f6234e34-1bef-48af-8ab2-a1c66fa72bb6 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:42.475189 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f6234e34-1bef-48af-8ab2-a1c66fa72bb6 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:42.619122 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-27827b76-1cbd-4531-8d99-5d20f582b942 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:42.622312 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-f6234e34-1bef-48af-8ab2-a1c66fa72bb6 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:42.627279 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-27827b76-1cbd-4531-8d99-5d20f582b942 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88" status: 200 len: 1734 microversion: 2.1 time: 0.170642 Mar 31 18:19:42.627922 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 272/553] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:42 2022] GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88 => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:19:42.628711 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-f6234e34-1bef-48af-8ab2-a1c66fa72bb6 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:42.630224 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-f6234e34-1bef-48af-8ab2-a1c66fa72bb6 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:42.631411 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-f6234e34-1bef-48af-8ab2-a1c66fa72bb6 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1809 microversion: 2.20 time: 0.169917 Mar 31 18:19:42.631952 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 282/554] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:19:42 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1809 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 31 18:19:42.835650 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-5c2f3532-3751-474e-9e36-088adb49c90e tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:42.836259 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-5c2f3532-3751-474e-9e36-088adb49c90e tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: 06c9b67d-f63b-4be1-ab26-18346902f6e3] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:42.842906 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-5c2f3532-3751-474e-9e36-088adb49c90e tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:42.843347 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-5c2f3532-3751-474e-9e36-088adb49c90e tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:42.844094 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-5c2f3532-3751-474e-9e36-088adb49c90e tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:42.844521 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-5c2f3532-3751-474e-9e36-088adb49c90e tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:42.982553 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-5c2f3532-3751-474e-9e36-088adb49c90e tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:42.989725 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-5c2f3532-3751-474e-9e36-088adb49c90e tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/06c9b67d-f63b-4be1-ab26-18346902f6e3" status: 200 len: 1265 microversion: 2.1 time: 0.157871 Mar 31 18:19:42.990292 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 273/555] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:42 2022] GET /compute/v2.1/servers/06c9b67d-f63b-4be1-ab26-18346902f6e3 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:19:43.085620 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-49d3f960-c2ec-40ed-ba8b-f17fd9363314 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:43.086258 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-49d3f960-c2ec-40ed-ba8b-f17fd9363314 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:43.092789 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-49d3f960-c2ec-40ed-ba8b-f17fd9363314 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:43.093233 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-49d3f960-c2ec-40ed-ba8b-f17fd9363314 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:43.093986 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-49d3f960-c2ec-40ed-ba8b-f17fd9363314 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:43.094415 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-49d3f960-c2ec-40ed-ba8b-f17fd9363314 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:43.228881 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-49d3f960-c2ec-40ed-ba8b-f17fd9363314 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:43.236301 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-49d3f960-c2ec-40ed-ba8b-f17fd9363314 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1259 microversion: 2.1 time: 0.154846 Mar 31 18:19:43.236808 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 283/556] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:43 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1259 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:19:43.645328 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-822ca23c-14ff-405b-ad86-0cbe43b6c8b1 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:43.645839 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-822ca23c-14ff-405b-ad86-0cbe43b6c8b1 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: a2498a53-f6d8-4236-8788-289622fc2c88] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:43.649731 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-4f08805a-4494-4f0c-a496-e735d7c3ddcd tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:43.650335 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-4f08805a-4494-4f0c-a496-e735d7c3ddcd tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:43.651876 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-822ca23c-14ff-405b-ad86-0cbe43b6c8b1 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:43.652347 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-822ca23c-14ff-405b-ad86-0cbe43b6c8b1 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:43.653106 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-822ca23c-14ff-405b-ad86-0cbe43b6c8b1 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:43.653529 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-822ca23c-14ff-405b-ad86-0cbe43b6c8b1 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:43.656761 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4f08805a-4494-4f0c-a496-e735d7c3ddcd tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:43.657280 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4f08805a-4494-4f0c-a496-e735d7c3ddcd tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:43.658041 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4f08805a-4494-4f0c-a496-e735d7c3ddcd tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:43.658476 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4f08805a-4494-4f0c-a496-e735d7c3ddcd tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:43.791906 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-822ca23c-14ff-405b-ad86-0cbe43b6c8b1 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:43.792746 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-4f08805a-4494-4f0c-a496-e735d7c3ddcd tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:43.799877 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-822ca23c-14ff-405b-ad86-0cbe43b6c8b1 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88" status: 200 len: 1734 microversion: 2.1 time: 0.158512 Mar 31 18:19:43.800535 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 274/557] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:43 2022] GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88 => generated 1734 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:19:43.801313 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-4f08805a-4494-4f0c-a496-e735d7c3ddcd tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:43.803030 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-4f08805a-4494-4f0c-a496-e735d7c3ddcd tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:43.804177 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-4f08805a-4494-4f0c-a496-e735d7c3ddcd tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1809 microversion: 2.20 time: 0.158312 Mar 31 18:19:43.804718 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 284/558] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:19:43 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 31 18:19:44.006455 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-b5a7e84d-18f6-430e-aa43-da7194b66e56 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:44.007109 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-b5a7e84d-18f6-430e-aa43-da7194b66e56 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: 06c9b67d-f63b-4be1-ab26-18346902f6e3] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:44.013684 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b5a7e84d-18f6-430e-aa43-da7194b66e56 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:44.014133 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b5a7e84d-18f6-430e-aa43-da7194b66e56 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:44.014922 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b5a7e84d-18f6-430e-aa43-da7194b66e56 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:44.015357 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b5a7e84d-18f6-430e-aa43-da7194b66e56 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:44.153962 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-b5a7e84d-18f6-430e-aa43-da7194b66e56 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:44.161189 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-b5a7e84d-18f6-430e-aa43-da7194b66e56 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/06c9b67d-f63b-4be1-ab26-18346902f6e3" status: 200 len: 1265 microversion: 2.1 time: 0.158719 Mar 31 18:19:44.161753 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 275/559] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:44 2022] GET /compute/v2.1/servers/06c9b67d-f63b-4be1-ab26-18346902f6e3 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:19:44.253824 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-27d4565a-a3d6-46de-95ea-7b84b5edf8d4 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:44.254629 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-27d4565a-a3d6-46de-95ea-7b84b5edf8d4 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:44.261472 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-27d4565a-a3d6-46de-95ea-7b84b5edf8d4 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:44.265164 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-27d4565a-a3d6-46de-95ea-7b84b5edf8d4 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:44.265164 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-27d4565a-a3d6-46de-95ea-7b84b5edf8d4 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:44.265164 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-27d4565a-a3d6-46de-95ea-7b84b5edf8d4 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:44.322298 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [req-c84c100c-49b0-427d-81ac-c593c6ca667b req-d6a46bfb-c184-4a72-a3a1-70af31be5fc4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0", "name": "network-vif-plugged", "status": "completed", "tag": "3bfd294a-f954-4562-8fbf-0cd104ab3bee"}]} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:19:44.340916 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-c84c100c-49b0-427d-81ac-c593c6ca667b req-d6a46bfb-c184-4a72-a3a1-70af31be5fc4 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:44.341340 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-c84c100c-49b0-427d-81ac-c593c6ca667b req-d6a46bfb-c184-4a72-a3a1-70af31be5fc4 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:44.358471 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.compute.server_external_events [req-c84c100c-49b0-427d-81ac-c593c6ca667b req-d6a46bfb-c184-4a72-a3a1-70af31be5fc4 service nova] Creating event network-vif-plugged:3bfd294a-f954-4562-8fbf-0cd104ab3bee for instance 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 on hv-cinder-maste Mar 31 18:19:44.375697 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [req-c84c100c-49b0-427d-81ac-c593c6ca667b req-d6a46bfb-c184-4a72-a3a1-70af31be5fc4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056994 Mar 31 18:19:44.379087 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 276/560] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:19:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 31 18:19:44.436273 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-27d4565a-a3d6-46de-95ea-7b84b5edf8d4 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:44.443719 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-27d4565a-a3d6-46de-95ea-7b84b5edf8d4 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1259 microversion: 2.1 time: 0.194019 Mar 31 18:19:44.444290 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 285/561] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:44 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1259 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:19:44.817812 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-88e696fc-6568-4565-94a0-9660ed1c37a4 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:44.818515 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-88e696fc-6568-4565-94a0-9660ed1c37a4 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: a2498a53-f6d8-4236-8788-289622fc2c88] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:44.823622 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-0c324dfc-fbb4-4973-8b34-cf2b38374247 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:44.824245 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-0c324dfc-fbb4-4973-8b34-cf2b38374247 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:44.825407 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-88e696fc-6568-4565-94a0-9660ed1c37a4 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:44.825844 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-88e696fc-6568-4565-94a0-9660ed1c37a4 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:44.826597 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-88e696fc-6568-4565-94a0-9660ed1c37a4 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:44.827069 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-88e696fc-6568-4565-94a0-9660ed1c37a4 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:44.830233 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-0c324dfc-fbb4-4973-8b34-cf2b38374247 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:44.830702 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-0c324dfc-fbb4-4973-8b34-cf2b38374247 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:44.831454 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-0c324dfc-fbb4-4973-8b34-cf2b38374247 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:44.831883 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-0c324dfc-fbb4-4973-8b34-cf2b38374247 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:44.975847 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-88e696fc-6568-4565-94a0-9660ed1c37a4 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:44.983746 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-0c324dfc-fbb4-4973-8b34-cf2b38374247 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:44.985302 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-88e696fc-6568-4565-94a0-9660ed1c37a4 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88" status: 200 len: 1734 microversion: 2.1 time: 0.171783 Mar 31 18:19:44.986201 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 277/562] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:44 2022] GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88 => generated 1734 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:19:44.993756 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-0c324dfc-fbb4-4973-8b34-cf2b38374247 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:45.003182 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-0c324dfc-fbb4-4973-8b34-cf2b38374247 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:45.004451 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-0c324dfc-fbb4-4973-8b34-cf2b38374247 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1809 microversion: 2.20 time: 0.185568 Mar 31 18:19:45.005159 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 286/563] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:19:44 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1809 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 31 18:19:45.178171 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-397e35c6-d137-4242-af57-cd056ae4201f tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:45.178747 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-397e35c6-d137-4242-af57-cd056ae4201f tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: 06c9b67d-f63b-4be1-ab26-18346902f6e3] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:45.184716 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-397e35c6-d137-4242-af57-cd056ae4201f tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:45.185194 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-397e35c6-d137-4242-af57-cd056ae4201f tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:45.185970 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-397e35c6-d137-4242-af57-cd056ae4201f tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:45.186402 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-397e35c6-d137-4242-af57-cd056ae4201f tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:45.325042 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-397e35c6-d137-4242-af57-cd056ae4201f tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:45.332207 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-397e35c6-d137-4242-af57-cd056ae4201f tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/06c9b67d-f63b-4be1-ab26-18346902f6e3" status: 200 len: 1265 microversion: 2.1 time: 0.157994 Mar 31 18:19:45.332763 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 278/564] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:45 2022] GET /compute/v2.1/servers/06c9b67d-f63b-4be1-ab26-18346902f6e3 => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:19:45.461118 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-86f40f7a-ca7a-4737-9093-72da405e08e9 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:45.461640 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-86f40f7a-ca7a-4737-9093-72da405e08e9 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:45.468128 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-86f40f7a-ca7a-4737-9093-72da405e08e9 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:45.468563 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-86f40f7a-ca7a-4737-9093-72da405e08e9 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:45.469314 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-86f40f7a-ca7a-4737-9093-72da405e08e9 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:45.469735 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-86f40f7a-ca7a-4737-9093-72da405e08e9 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:45.604759 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-86f40f7a-ca7a-4737-9093-72da405e08e9 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:45.611992 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-86f40f7a-ca7a-4737-9093-72da405e08e9 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1443 microversion: 2.1 time: 0.154777 Mar 31 18:19:45.612547 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 287/565] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:45 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1443 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:19:45.628786 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-50c06465-c36f-4e1d-ac58-f7f4eb824ef0 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:45.629381 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-50c06465-c36f-4e1d-ac58-f7f4eb824ef0 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:45.635750 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-50c06465-c36f-4e1d-ac58-f7f4eb824ef0 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:45.636181 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-50c06465-c36f-4e1d-ac58-f7f4eb824ef0 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:45.637183 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-50c06465-c36f-4e1d-ac58-f7f4eb824ef0 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:45.637602 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-50c06465-c36f-4e1d-ac58-f7f4eb824ef0 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:45.767040 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-50c06465-c36f-4e1d-ac58-f7f4eb824ef0 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:45.774329 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-50c06465-c36f-4e1d-ac58-f7f4eb824ef0 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1443 microversion: 2.1 time: 0.149342 Mar 31 18:19:45.774913 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 279/566] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:45 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1443 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:19:46.003207 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-a9a66170-66ee-41b5-982f-a8d90d43e0c6 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:46.003813 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-a9a66170-66ee-41b5-982f-a8d90d43e0c6 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: a2498a53-f6d8-4236-8788-289622fc2c88] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:46.010170 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a9a66170-66ee-41b5-982f-a8d90d43e0c6 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:46.011097 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a9a66170-66ee-41b5-982f-a8d90d43e0c6 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:46.012131 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a9a66170-66ee-41b5-982f-a8d90d43e0c6 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:46.012559 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a9a66170-66ee-41b5-982f-a8d90d43e0c6 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:46.023591 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-da39efda-a624-4fbf-80ef-a60fa7ba05bd tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:46.024184 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-da39efda-a624-4fbf-80ef-a60fa7ba05bd tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:46.031236 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-da39efda-a624-4fbf-80ef-a60fa7ba05bd tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:46.031673 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-da39efda-a624-4fbf-80ef-a60fa7ba05bd tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:46.032428 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-da39efda-a624-4fbf-80ef-a60fa7ba05bd tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:46.032850 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-da39efda-a624-4fbf-80ef-a60fa7ba05bd tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:46.151438 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-a9a66170-66ee-41b5-982f-a8d90d43e0c6 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:46.159095 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-a9a66170-66ee-41b5-982f-a8d90d43e0c6 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88" status: 200 len: 1734 microversion: 2.1 time: 0.159749 Mar 31 18:19:46.169131 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 288/567] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:45 2022] GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:19:46.251287 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-da39efda-a624-4fbf-80ef-a60fa7ba05bd tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:46.259751 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-da39efda-a624-4fbf-80ef-a60fa7ba05bd tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:46.261390 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-da39efda-a624-4fbf-80ef-a60fa7ba05bd tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:46.262960 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-da39efda-a624-4fbf-80ef-a60fa7ba05bd tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1809 microversion: 2.20 time: 0.243229 Mar 31 18:19:46.270959 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 280/568] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:19:46 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1809 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 31 18:19:46.349331 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-5eaca08f-6eaa-46c7-8c80-1f05e00442da tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:46.349974 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-5eaca08f-6eaa-46c7-8c80-1f05e00442da tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: 06c9b67d-f63b-4be1-ab26-18346902f6e3] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:46.356392 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-5eaca08f-6eaa-46c7-8c80-1f05e00442da tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:46.356844 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-5eaca08f-6eaa-46c7-8c80-1f05e00442da tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:46.357747 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-5eaca08f-6eaa-46c7-8c80-1f05e00442da tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:46.358054 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-5eaca08f-6eaa-46c7-8c80-1f05e00442da tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:46.499103 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-5eaca08f-6eaa-46c7-8c80-1f05e00442da tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:46.506190 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-5eaca08f-6eaa-46c7-8c80-1f05e00442da tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/06c9b67d-f63b-4be1-ab26-18346902f6e3" status: 200 len: 1265 microversion: 2.1 time: 0.160764 Mar 31 18:19:46.506768 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 289/569] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:46 2022] GET /compute/v2.1/servers/06c9b67d-f63b-4be1-ab26-18346902f6e3 => generated 1265 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:19:47.175554 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-a55bace0-2669-45b0-9957-bc7661e7d618 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:47.176180 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-a55bace0-2669-45b0-9957-bc7661e7d618 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: a2498a53-f6d8-4236-8788-289622fc2c88] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:47.182158 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a55bace0-2669-45b0-9957-bc7661e7d618 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:47.182504 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a55bace0-2669-45b0-9957-bc7661e7d618 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:47.184026 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a55bace0-2669-45b0-9957-bc7661e7d618 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:47.184026 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a55bace0-2669-45b0-9957-bc7661e7d618 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:47.281898 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-d43d02ad-9207-467b-9ac7-b2c9d8d65fe4 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:47.282848 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-d43d02ad-9207-467b-9ac7-b2c9d8d65fe4 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:47.289015 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-d43d02ad-9207-467b-9ac7-b2c9d8d65fe4 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:47.289461 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-d43d02ad-9207-467b-9ac7-b2c9d8d65fe4 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:47.290224 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-d43d02ad-9207-467b-9ac7-b2c9d8d65fe4 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:47.290683 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-d43d02ad-9207-467b-9ac7-b2c9d8d65fe4 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:47.438927 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-d43d02ad-9207-467b-9ac7-b2c9d8d65fe4 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:47.449089 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-d43d02ad-9207-467b-9ac7-b2c9d8d65fe4 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:47.450603 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-d43d02ad-9207-467b-9ac7-b2c9d8d65fe4 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:47.451818 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-d43d02ad-9207-467b-9ac7-b2c9d8d65fe4 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1809 microversion: 2.20 time: 0.174127 Mar 31 18:19:47.452441 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 290/570] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:19:47 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1809 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 31 18:19:47.523873 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-252e369b-3f62-42db-86a2-d19f8d1b8981 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:47.524473 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-252e369b-3f62-42db-86a2-d19f8d1b8981 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: 06c9b67d-f63b-4be1-ab26-18346902f6e3] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:47.531189 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-252e369b-3f62-42db-86a2-d19f8d1b8981 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:47.531636 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-252e369b-3f62-42db-86a2-d19f8d1b8981 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:47.532426 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-252e369b-3f62-42db-86a2-d19f8d1b8981 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:47.532859 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-252e369b-3f62-42db-86a2-d19f8d1b8981 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:47.590346 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-a55bace0-2669-45b0-9957-bc7661e7d618 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:47.599717 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-a55bace0-2669-45b0-9957-bc7661e7d618 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88" status: 200 len: 1734 microversion: 2.1 time: 0.427683 Mar 31 18:19:47.600769 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 281/571] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:47 2022] GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88 => generated 1734 bytes in 429 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:19:47.679860 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-252e369b-3f62-42db-86a2-d19f8d1b8981 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:47.688134 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-252e369b-3f62-42db-86a2-d19f8d1b8981 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/06c9b67d-f63b-4be1-ab26-18346902f6e3" status: 200 len: 1265 microversion: 2.1 time: 0.168059 Mar 31 18:19:47.691601 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 291/572] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:47 2022] GET /compute/v2.1/servers/06c9b67d-f63b-4be1-ab26-18346902f6e3 => generated 1265 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:19:48.475602 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-aa4d6275-7adb-4ed8-91c5-9a4be74541d2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:48.476240 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-aa4d6275-7adb-4ed8-91c5-9a4be74541d2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:48.483629 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-aa4d6275-7adb-4ed8-91c5-9a4be74541d2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:48.484088 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-aa4d6275-7adb-4ed8-91c5-9a4be74541d2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:48.484869 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-aa4d6275-7adb-4ed8-91c5-9a4be74541d2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:48.485304 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-aa4d6275-7adb-4ed8-91c5-9a4be74541d2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:48.550040 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [req-a5973731-feea-4c37-8795-095e57ff6b88 req-7822422d-ea85-4873-91e7-8a8dfb6ff2f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61abeff2-268a-4149-9962-497c409663ed", "tag": "156f9ff9-ec0d-4ac3-a7d7-2fa14dbead9a"}]} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:19:48.559279 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-a5973731-feea-4c37-8795-095e57ff6b88 req-7822422d-ea85-4873-91e7-8a8dfb6ff2f0 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:48.559730 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-a5973731-feea-4c37-8795-095e57ff6b88 req-7822422d-ea85-4873-91e7-8a8dfb6ff2f0 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:48.570992 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.compute.server_external_events [req-a5973731-feea-4c37-8795-095e57ff6b88 req-7822422d-ea85-4873-91e7-8a8dfb6ff2f0 service nova] Creating event network-changed:156f9ff9-ec0d-4ac3-a7d7-2fa14dbead9a for instance 61abeff2-268a-4149-9962-497c409663ed on hv-cinder-maste Mar 31 18:19:48.577493 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [req-a5973731-feea-4c37-8795-095e57ff6b88 req-7822422d-ea85-4873-91e7-8a8dfb6ff2f0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110430 Mar 31 18:19:48.578413 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 282/573] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:19:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:19:48.617931 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-87e84449-6890-4caa-83cf-e2f9caca7b31 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:48.620109 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-87e84449-6890-4caa-83cf-e2f9caca7b31 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: a2498a53-f6d8-4236-8788-289622fc2c88] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:48.626515 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-87e84449-6890-4caa-83cf-e2f9caca7b31 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:48.627227 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-87e84449-6890-4caa-83cf-e2f9caca7b31 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:48.628178 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-87e84449-6890-4caa-83cf-e2f9caca7b31 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:48.628767 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-87e84449-6890-4caa-83cf-e2f9caca7b31 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:48.633450 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-aa4d6275-7adb-4ed8-91c5-9a4be74541d2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:48.644856 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-aa4d6275-7adb-4ed8-91c5-9a4be74541d2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:48.646525 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-aa4d6275-7adb-4ed8-91c5-9a4be74541d2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:48.647875 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-aa4d6275-7adb-4ed8-91c5-9a4be74541d2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1809 microversion: 2.20 time: 0.176097 Mar 31 18:19:48.649212 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 292/574] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:19:48 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1809 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:19:48.707514 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-110ffa24-c059-41d3-96a6-84b18060d9d2 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:48.708497 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-110ffa24-c059-41d3-96a6-84b18060d9d2 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: 06c9b67d-f63b-4be1-ab26-18346902f6e3] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:48.716064 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-110ffa24-c059-41d3-96a6-84b18060d9d2 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:48.716839 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-110ffa24-c059-41d3-96a6-84b18060d9d2 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:48.717858 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-110ffa24-c059-41d3-96a6-84b18060d9d2 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:48.718805 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-110ffa24-c059-41d3-96a6-84b18060d9d2 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:48.778911 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-87e84449-6890-4caa-83cf-e2f9caca7b31 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:48.787595 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-87e84449-6890-4caa-83cf-e2f9caca7b31 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88" status: 200 len: 1734 microversion: 2.1 time: 0.173807 Mar 31 18:19:48.788457 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 283/575] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:48 2022] GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88 => generated 1734 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:19:48.972304 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-110ffa24-c059-41d3-96a6-84b18060d9d2 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:48.984223 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-110ffa24-c059-41d3-96a6-84b18060d9d2 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/06c9b67d-f63b-4be1-ab26-18346902f6e3" status: 200 len: 1265 microversion: 2.1 time: 0.280237 Mar 31 18:19:48.984811 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 293/576] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:48 2022] GET /compute/v2.1/servers/06c9b67d-f63b-4be1-ab26-18346902f6e3 => generated 1265 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:19:49.667000 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-b42d75cf-097f-4775-9d18-867a9b26873c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:49.667609 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-b42d75cf-097f-4775-9d18-867a9b26873c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:49.673471 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b42d75cf-097f-4775-9d18-867a9b26873c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:49.673902 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b42d75cf-097f-4775-9d18-867a9b26873c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:49.674671 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b42d75cf-097f-4775-9d18-867a9b26873c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:49.675095 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b42d75cf-097f-4775-9d18-867a9b26873c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:49.805333 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-c6941708-6649-419f-a0af-7ecd8a7ac9c1 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:49.805852 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-c6941708-6649-419f-a0af-7ecd8a7ac9c1 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: a2498a53-f6d8-4236-8788-289622fc2c88] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:49.811176 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-b42d75cf-097f-4775-9d18-867a9b26873c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:49.812869 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c6941708-6649-419f-a0af-7ecd8a7ac9c1 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:49.813314 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c6941708-6649-419f-a0af-7ecd8a7ac9c1 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:49.814073 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c6941708-6649-419f-a0af-7ecd8a7ac9c1 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:49.814499 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c6941708-6649-419f-a0af-7ecd8a7ac9c1 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:49.819630 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-b42d75cf-097f-4775-9d18-867a9b26873c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:49.821124 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-b42d75cf-097f-4775-9d18-867a9b26873c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:49.822350 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-b42d75cf-097f-4775-9d18-867a9b26873c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1796 microversion: 2.20 time: 0.160147 Mar 31 18:19:49.823198 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 284/577] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:19:49 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1796 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:19:49.950385 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-c6941708-6649-419f-a0af-7ecd8a7ac9c1 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:49.958880 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-c6941708-6649-419f-a0af-7ecd8a7ac9c1 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88" status: 200 len: 1734 microversion: 2.1 time: 0.157370 Mar 31 18:19:49.959578 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 294/578] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:49 2022] GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:19:50.003269 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-49d8bc07-f491-41b5-993e-095e201ca99a tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:50.003908 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-49d8bc07-f491-41b5-993e-095e201ca99a tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: 06c9b67d-f63b-4be1-ab26-18346902f6e3] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:50.010878 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-49d8bc07-f491-41b5-993e-095e201ca99a tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:50.011322 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-49d8bc07-f491-41b5-993e-095e201ca99a tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:50.012344 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-49d8bc07-f491-41b5-993e-095e201ca99a tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:50.012776 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-49d8bc07-f491-41b5-993e-095e201ca99a tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:50.160769 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-49d8bc07-f491-41b5-993e-095e201ca99a tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:50.169220 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-49d8bc07-f491-41b5-993e-095e201ca99a tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/06c9b67d-f63b-4be1-ab26-18346902f6e3" status: 200 len: 1265 microversion: 2.1 time: 0.169800 Mar 31 18:19:50.169853 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 285/579] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:49 2022] GET /compute/v2.1/servers/06c9b67d-f63b-4be1-ab26-18346902f6e3 => generated 1265 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:19:50.976352 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-567cb29a-54d3-44c3-b64f-f287f1c9ac5b tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:50.976951 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-567cb29a-54d3-44c3-b64f-f287f1c9ac5b tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: a2498a53-f6d8-4236-8788-289622fc2c88] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:50.983846 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-567cb29a-54d3-44c3-b64f-f287f1c9ac5b tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:50.984384 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-567cb29a-54d3-44c3-b64f-f287f1c9ac5b tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:50.985129 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-567cb29a-54d3-44c3-b64f-f287f1c9ac5b tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:50.985556 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-567cb29a-54d3-44c3-b64f-f287f1c9ac5b tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:51.115177 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-567cb29a-54d3-44c3-b64f-f287f1c9ac5b tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:51.123146 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-567cb29a-54d3-44c3-b64f-f287f1c9ac5b tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88" status: 200 len: 1734 microversion: 2.1 time: 0.150982 Mar 31 18:19:51.123704 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 295/580] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:50 2022] GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:19:51.190355 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-9ea9680f-3c7c-40b3-886a-2df17b4b2ff9 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:51.190983 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-9ea9680f-3c7c-40b3-886a-2df17b4b2ff9 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: 06c9b67d-f63b-4be1-ab26-18346902f6e3] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:51.196768 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9ea9680f-3c7c-40b3-886a-2df17b4b2ff9 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:51.197835 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9ea9680f-3c7c-40b3-886a-2df17b4b2ff9 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:51.198587 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9ea9680f-3c7c-40b3-886a-2df17b4b2ff9 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:51.199045 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9ea9680f-3c7c-40b3-886a-2df17b4b2ff9 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:51.332326 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-9ea9680f-3c7c-40b3-886a-2df17b4b2ff9 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:51.340649 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-9ea9680f-3c7c-40b3-886a-2df17b4b2ff9 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/06c9b67d-f63b-4be1-ab26-18346902f6e3" status: 200 len: 1265 microversion: 2.1 time: 0.154177 Mar 31 18:19:51.341215 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 286/581] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:51 2022] GET /compute/v2.1/servers/06c9b67d-f63b-4be1-ab26-18346902f6e3 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:19:52.142504 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-c3a52037-b831-4829-88bd-7889519afcec tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:52.143315 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-c3a52037-b831-4829-88bd-7889519afcec tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: a2498a53-f6d8-4236-8788-289622fc2c88] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:52.149412 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c3a52037-b831-4829-88bd-7889519afcec tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:52.149856 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c3a52037-b831-4829-88bd-7889519afcec tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:52.150756 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c3a52037-b831-4829-88bd-7889519afcec tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:52.151182 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c3a52037-b831-4829-88bd-7889519afcec tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:52.288372 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-c3a52037-b831-4829-88bd-7889519afcec tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:52.296926 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-c3a52037-b831-4829-88bd-7889519afcec tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88" status: 200 len: 1734 microversion: 2.1 time: 0.158711 Mar 31 18:19:52.297486 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 296/582] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:52 2022] GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88 => generated 1734 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:19:52.357656 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-ec460e91-a107-4571-834f-0462eeb34d37 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:52.358259 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-ec460e91-a107-4571-834f-0462eeb34d37 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: 06c9b67d-f63b-4be1-ab26-18346902f6e3] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:52.364139 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ec460e91-a107-4571-834f-0462eeb34d37 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:52.364584 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ec460e91-a107-4571-834f-0462eeb34d37 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:52.365376 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ec460e91-a107-4571-834f-0462eeb34d37 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:52.365798 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ec460e91-a107-4571-834f-0462eeb34d37 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:52.504358 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-ec460e91-a107-4571-834f-0462eeb34d37 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:52.511947 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-ec460e91-a107-4571-834f-0462eeb34d37 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/06c9b67d-f63b-4be1-ab26-18346902f6e3" status: 200 len: 1265 microversion: 2.1 time: 0.158407 Mar 31 18:19:52.512525 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 287/583] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:52 2022] GET /compute/v2.1/servers/06c9b67d-f63b-4be1-ab26-18346902f6e3 => generated 1265 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:19:53.314242 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-39db00ab-8fe4-4096-aa22-eea0628e3e5e tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:53.314804 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-39db00ab-8fe4-4096-aa22-eea0628e3e5e tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: a2498a53-f6d8-4236-8788-289622fc2c88] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:53.321035 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-39db00ab-8fe4-4096-aa22-eea0628e3e5e tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:53.321476 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-39db00ab-8fe4-4096-aa22-eea0628e3e5e tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:53.322258 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-39db00ab-8fe4-4096-aa22-eea0628e3e5e tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:53.322712 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-39db00ab-8fe4-4096-aa22-eea0628e3e5e tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:53.452930 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-39db00ab-8fe4-4096-aa22-eea0628e3e5e tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:53.460556 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-39db00ab-8fe4-4096-aa22-eea0628e3e5e tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88" status: 200 len: 1734 microversion: 2.1 time: 0.150297 Mar 31 18:19:53.461106 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 297/584] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:53 2022] GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:19:53.529194 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-a5590d47-ddea-4f67-98fb-70aa3d0e7372 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:53.529829 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-a5590d47-ddea-4f67-98fb-70aa3d0e7372 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: 06c9b67d-f63b-4be1-ab26-18346902f6e3] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:53.535702 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a5590d47-ddea-4f67-98fb-70aa3d0e7372 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:53.536140 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a5590d47-ddea-4f67-98fb-70aa3d0e7372 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:53.536888 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a5590d47-ddea-4f67-98fb-70aa3d0e7372 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:53.537313 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a5590d47-ddea-4f67-98fb-70aa3d0e7372 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:53.668844 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-a5590d47-ddea-4f67-98fb-70aa3d0e7372 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:53.676101 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-a5590d47-ddea-4f67-98fb-70aa3d0e7372 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/06c9b67d-f63b-4be1-ab26-18346902f6e3" status: 200 len: 1265 microversion: 2.1 time: 0.151423 Mar 31 18:19:53.676666 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 288/585] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:53 2022] GET /compute/v2.1/servers/06c9b67d-f63b-4be1-ab26-18346902f6e3 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:19:54.189356 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [req-d1af66d3-a0d9-492d-84a9-4141f89839dc req-acdbbb85-cb1f-4a06-b256-dfe8365f76d9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06c9b67d-f63b-4be1-ab26-18346902f6e3", "name": "network-vif-plugged", "status": "completed", "tag": "d73baa13-9b78-4d3b-b347-b15a781aadbe"}]} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:19:54.198052 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-d1af66d3-a0d9-492d-84a9-4141f89839dc req-acdbbb85-cb1f-4a06-b256-dfe8365f76d9 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:54.198510 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-d1af66d3-a0d9-492d-84a9-4141f89839dc req-acdbbb85-cb1f-4a06-b256-dfe8365f76d9 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:54.209412 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.compute.server_external_events [req-d1af66d3-a0d9-492d-84a9-4141f89839dc req-acdbbb85-cb1f-4a06-b256-dfe8365f76d9 service nova] Creating event network-vif-plugged:d73baa13-9b78-4d3b-b347-b15a781aadbe for instance 06c9b67d-f63b-4be1-ab26-18346902f6e3 on hv-cinder-maste Mar 31 18:19:54.214625 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [req-d1af66d3-a0d9-492d-84a9-4141f89839dc req-acdbbb85-cb1f-4a06-b256-dfe8365f76d9 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029075 Mar 31 18:19:54.215222 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 298/586] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:19:54.477273 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-0cc5a759-47ec-4995-95e6-05e4d11b216f tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:54.477878 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-0cc5a759-47ec-4995-95e6-05e4d11b216f tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: a2498a53-f6d8-4236-8788-289622fc2c88] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:54.483839 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0cc5a759-47ec-4995-95e6-05e4d11b216f tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:54.484288 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0cc5a759-47ec-4995-95e6-05e4d11b216f tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:54.485045 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0cc5a759-47ec-4995-95e6-05e4d11b216f tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:54.485470 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0cc5a759-47ec-4995-95e6-05e4d11b216f tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:54.620594 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-0cc5a759-47ec-4995-95e6-05e4d11b216f tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:54.628438 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-0cc5a759-47ec-4995-95e6-05e4d11b216f tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88" status: 200 len: 1714 microversion: 2.1 time: 0.155147 Mar 31 18:19:54.629005 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 289/587] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:54 2022] GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88 => generated 1714 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:19:54.687662 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-4f8e3424-a97f-42b3-b5bf-9a95d0a0ad15 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:54.688320 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-4f8e3424-a97f-42b3-b5bf-9a95d0a0ad15 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: a2498a53-f6d8-4236-8788-289622fc2c88] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:54.694563 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4f8e3424-a97f-42b3-b5bf-9a95d0a0ad15 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:54.695035 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4f8e3424-a97f-42b3-b5bf-9a95d0a0ad15 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:54.695624 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-e19b62d5-e070-436c-8456-e4e2c476f403 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:54.695813 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4f8e3424-a97f-42b3-b5bf-9a95d0a0ad15 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:54.696209 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4f8e3424-a97f-42b3-b5bf-9a95d0a0ad15 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:54.696354 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-e19b62d5-e070-436c-8456-e4e2c476f403 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: 06c9b67d-f63b-4be1-ab26-18346902f6e3] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:54.702832 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e19b62d5-e070-436c-8456-e4e2c476f403 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:54.703276 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e19b62d5-e070-436c-8456-e4e2c476f403 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:54.704243 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e19b62d5-e070-436c-8456-e4e2c476f403 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:54.704681 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e19b62d5-e070-436c-8456-e4e2c476f403 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:54.824824 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.wsgi [None req-4f8e3424-a97f-42b3-b5bf-9a95d0a0ad15 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] HTTP exception thrown: Cannot 'detach_volume' instance a2498a53-f6d8-4236-8788-289622fc2c88 while it is in vm_state rescued Mar 31 18:19:54.829052 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-4f8e3424-a97f-42b3-b5bf-9a95d0a0ad15 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Returning 409 to user: Cannot 'detach_volume' instance a2498a53-f6d8-4236-8788-289622fc2c88 while it is in vm_state rescued {{(pid=117538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:19:54.829052 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-4f8e3424-a97f-42b3-b5bf-9a95d0a0ad15 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88/os-volume_attachments/d8adbe01-d460-446c-bf13-348f060af096" status: 409 len: 152 microversion: 2.1 time: 0.143673 Mar 31 18:19:54.829052 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 299/588] 10.222.0.58 () {58 vars in 1415 bytes} [Thu Mar 31 18:19:54 2022] DELETE /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88/os-volume_attachments/d8adbe01-d460-446c-bf13-348f060af096 => generated 152 bytes in 146 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Mar 31 18:19:54.835883 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-b6f65c7e-f3bb-4d1f-a64f-cf7d4cee05cf tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:19:54.836402 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-b6f65c7e-f3bb-4d1f-a64f-cf7d4cee05cf tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: a2498a53-f6d8-4236-8788-289622fc2c88] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:54.843043 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b6f65c7e-f3bb-4d1f-a64f-cf7d4cee05cf tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:54.843497 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b6f65c7e-f3bb-4d1f-a64f-cf7d4cee05cf tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:54.844259 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b6f65c7e-f3bb-4d1f-a64f-cf7d4cee05cf tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:54.844914 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b6f65c7e-f3bb-4d1f-a64f-cf7d4cee05cf tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:54.849621 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-e19b62d5-e070-436c-8456-e4e2c476f403 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:54.857419 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-e19b62d5-e070-436c-8456-e4e2c476f403 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/06c9b67d-f63b-4be1-ab26-18346902f6e3" status: 200 len: 1265 microversion: 2.1 time: 0.165512 Mar 31 18:19:54.857990 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 290/589] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:54 2022] GET /compute/v2.1/servers/06c9b67d-f63b-4be1-ab26-18346902f6e3 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:19:55.092446 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-b6f65c7e-f3bb-4d1f-a64f-cf7d4cee05cf tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "POST /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88/action" status: 202 len: 0 microversion: 2.1 time: 0.260168 Mar 31 18:19:55.093085 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 300/590] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Mar 31 18:19:54 2022] POST /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 31 18:19:55.101223 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-714cef16-a963-4d1e-9c1c-326ad3185c8c tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:55.101820 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-714cef16-a963-4d1e-9c1c-326ad3185c8c tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: a2498a53-f6d8-4236-8788-289622fc2c88] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:55.107682 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-714cef16-a963-4d1e-9c1c-326ad3185c8c tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:55.108131 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-714cef16-a963-4d1e-9c1c-326ad3185c8c tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:55.108903 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-714cef16-a963-4d1e-9c1c-326ad3185c8c tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:55.109328 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-714cef16-a963-4d1e-9c1c-326ad3185c8c tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:55.240165 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-714cef16-a963-4d1e-9c1c-326ad3185c8c tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:55.248679 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-714cef16-a963-4d1e-9c1c-326ad3185c8c tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88" status: 200 len: 1722 microversion: 2.1 time: 0.151390 Mar 31 18:19:55.249242 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 291/591] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:55 2022] GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88 => generated 1722 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:19:55.875155 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-26280a9f-b322-4855-8f7f-721944828f42 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:55.875854 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-26280a9f-b322-4855-8f7f-721944828f42 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: 06c9b67d-f63b-4be1-ab26-18346902f6e3] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:55.882365 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-26280a9f-b322-4855-8f7f-721944828f42 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:55.882785 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-26280a9f-b322-4855-8f7f-721944828f42 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:55.883556 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-26280a9f-b322-4855-8f7f-721944828f42 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:55.884023 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-26280a9f-b322-4855-8f7f-721944828f42 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:56.019340 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-26280a9f-b322-4855-8f7f-721944828f42 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:56.027180 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-26280a9f-b322-4855-8f7f-721944828f42 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/06c9b67d-f63b-4be1-ab26-18346902f6e3" status: 200 len: 1265 microversion: 2.1 time: 0.156364 Mar 31 18:19:56.027733 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 301/592] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:55 2022] GET /compute/v2.1/servers/06c9b67d-f63b-4be1-ab26-18346902f6e3 => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:19:56.266632 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-5631e470-394b-42bc-8032-cb66bcfb1372 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:56.267242 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-5631e470-394b-42bc-8032-cb66bcfb1372 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: a2498a53-f6d8-4236-8788-289622fc2c88] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:56.273135 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-5631e470-394b-42bc-8032-cb66bcfb1372 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:56.281004 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-5631e470-394b-42bc-8032-cb66bcfb1372 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:56.281004 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-5631e470-394b-42bc-8032-cb66bcfb1372 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:56.281004 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-5631e470-394b-42bc-8032-cb66bcfb1372 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:56.412482 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-5631e470-394b-42bc-8032-cb66bcfb1372 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:56.421144 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-5631e470-394b-42bc-8032-cb66bcfb1372 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88" status: 200 len: 1722 microversion: 2.1 time: 0.158398 Mar 31 18:19:56.421737 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 292/593] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:56 2022] GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:19:57.043893 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-1ebd580f-2197-4838-b5ce-b2e44c163e7d tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:57.044538 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-1ebd580f-2197-4838-b5ce-b2e44c163e7d tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: 06c9b67d-f63b-4be1-ab26-18346902f6e3] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:57.059200 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-1ebd580f-2197-4838-b5ce-b2e44c163e7d tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:57.059647 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-1ebd580f-2197-4838-b5ce-b2e44c163e7d tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:57.060423 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-1ebd580f-2197-4838-b5ce-b2e44c163e7d tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:57.060855 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-1ebd580f-2197-4838-b5ce-b2e44c163e7d tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:57.194819 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-1ebd580f-2197-4838-b5ce-b2e44c163e7d tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:57.202178 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-1ebd580f-2197-4838-b5ce-b2e44c163e7d tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/06c9b67d-f63b-4be1-ab26-18346902f6e3" status: 200 len: 1451 microversion: 2.1 time: 0.162277 Mar 31 18:19:57.202756 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 302/594] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:57 2022] GET /compute/v2.1/servers/06c9b67d-f63b-4be1-ab26-18346902f6e3 => generated 1451 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:19:57.218215 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-b205e4d3-abfb-4b2a-a198-c3d1be54971f tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:57.218858 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-b205e4d3-abfb-4b2a-a198-c3d1be54971f tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: 06c9b67d-f63b-4be1-ab26-18346902f6e3] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:57.224935 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b205e4d3-abfb-4b2a-a198-c3d1be54971f tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:57.225376 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b205e4d3-abfb-4b2a-a198-c3d1be54971f tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:57.226115 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b205e4d3-abfb-4b2a-a198-c3d1be54971f tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:57.226537 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b205e4d3-abfb-4b2a-a198-c3d1be54971f tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:57.405473 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-b205e4d3-abfb-4b2a-a198-c3d1be54971f tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:57.412659 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-b205e4d3-abfb-4b2a-a198-c3d1be54971f tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/06c9b67d-f63b-4be1-ab26-18346902f6e3" status: 200 len: 1451 microversion: 2.1 time: 0.198280 Mar 31 18:19:57.413223 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 293/595] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:57 2022] GET /compute/v2.1/servers/06c9b67d-f63b-4be1-ab26-18346902f6e3 => generated 1451 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:19:57.438213 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-2a4f72cc-ddbf-4f6a-9fc0-148e4898ff05 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:57.438835 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-2a4f72cc-ddbf-4f6a-9fc0-148e4898ff05 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: a2498a53-f6d8-4236-8788-289622fc2c88] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:57.444650 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-2a4f72cc-ddbf-4f6a-9fc0-148e4898ff05 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:57.444971 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-2a4f72cc-ddbf-4f6a-9fc0-148e4898ff05 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:57.445774 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-2a4f72cc-ddbf-4f6a-9fc0-148e4898ff05 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:57.446145 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-2a4f72cc-ddbf-4f6a-9fc0-148e4898ff05 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:57.582906 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-2a4f72cc-ddbf-4f6a-9fc0-148e4898ff05 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:57.591277 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-2a4f72cc-ddbf-4f6a-9fc0-148e4898ff05 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88" status: 200 len: 1722 microversion: 2.1 time: 0.156791 Mar 31 18:19:57.591940 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 303/596] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:57 2022] GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:19:58.610059 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-712b1641-58e1-4a9f-9155-f25185e7c925 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:58.610686 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-712b1641-58e1-4a9f-9155-f25185e7c925 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: a2498a53-f6d8-4236-8788-289622fc2c88] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:58.617072 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-712b1641-58e1-4a9f-9155-f25185e7c925 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:58.617520 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-712b1641-58e1-4a9f-9155-f25185e7c925 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:58.618317 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-712b1641-58e1-4a9f-9155-f25185e7c925 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:58.619501 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-712b1641-58e1-4a9f-9155-f25185e7c925 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:58.832118 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-712b1641-58e1-4a9f-9155-f25185e7c925 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:19:58.841066 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-712b1641-58e1-4a9f-9155-f25185e7c925 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88" status: 200 len: 1722 microversion: 2.1 time: 0.234783 Mar 31 18:19:58.841701 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 294/597] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:58 2022] GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88 => generated 1722 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:19:59.729178 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [req-90b84c2c-8e0d-41ea-84d2-165a575d0f28 req-eb8664c9-8741-4b0d-8102-da37dc24a038 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "06c9b67d-f63b-4be1-ab26-18346902f6e3", "tag": "d73baa13-9b78-4d3b-b347-b15a781aadbe"}]} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:19:59.738234 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-90b84c2c-8e0d-41ea-84d2-165a575d0f28 req-eb8664c9-8741-4b0d-8102-da37dc24a038 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:59.738756 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-90b84c2c-8e0d-41ea-84d2-165a575d0f28 req-eb8664c9-8741-4b0d-8102-da37dc24a038 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:59.752819 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.compute.server_external_events [req-90b84c2c-8e0d-41ea-84d2-165a575d0f28 req-eb8664c9-8741-4b0d-8102-da37dc24a038 service nova] Creating event network-changed:d73baa13-9b78-4d3b-b347-b15a781aadbe for instance 06c9b67d-f63b-4be1-ab26-18346902f6e3 on hv-cinder-maste Mar 31 18:19:59.757691 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [req-90b84c2c-8e0d-41ea-84d2-165a575d0f28 req-eb8664c9-8741-4b0d-8102-da37dc24a038 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032802 Mar 31 18:19:59.758339 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 304/598] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:19:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:19:59.860757 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-c04d7004-5827-480b-ae96-69d198c0fbb9 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:19:59.861645 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-c04d7004-5827-480b-ae96-69d198c0fbb9 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: a2498a53-f6d8-4236-8788-289622fc2c88] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:19:59.867938 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c04d7004-5827-480b-ae96-69d198c0fbb9 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:59.869372 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c04d7004-5827-480b-ae96-69d198c0fbb9 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:19:59.870501 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c04d7004-5827-480b-ae96-69d198c0fbb9 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:19:59.871035 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c04d7004-5827-480b-ae96-69d198c0fbb9 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:20:00.013170 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-c04d7004-5827-480b-ae96-69d198c0fbb9 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:20:00.021176 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-c04d7004-5827-480b-ae96-69d198c0fbb9 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88" status: 200 len: 1728 microversion: 2.1 time: 0.165138 Mar 31 18:20:00.021775 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 295/599] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:19:59 2022] GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88 => generated 1728 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:20:00.039508 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-41e4deaa-04bd-41aa-9e3c-5847b15fe283 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:20:00.040109 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-41e4deaa-04bd-41aa-9e3c-5847b15fe283 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: a2498a53-f6d8-4236-8788-289622fc2c88] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:20:00.047367 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-41e4deaa-04bd-41aa-9e3c-5847b15fe283 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:20:00.047367 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-41e4deaa-04bd-41aa-9e3c-5847b15fe283 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:20:00.047992 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-41e4deaa-04bd-41aa-9e3c-5847b15fe283 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:20:00.048427 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-41e4deaa-04bd-41aa-9e3c-5847b15fe283 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:20:00.178968 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-41e4deaa-04bd-41aa-9e3c-5847b15fe283 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.144464 Mar 31 18:20:00.179654 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 305/600] 10.222.0.58 () {58 vars in 1274 bytes} [Thu Mar 31 18:20:00 2022] GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88/os-interface => generated 284 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:20:01.108933 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 31 18:20:01.109513 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: Thu Mar 31 18:20:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 31 18:20:01.772713 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [req-57f9a502-9079-4b26-b968-08a690966570 req-b16a12d7-cae9-4b42-855c-c59f0d6adc31 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a2498a53-f6d8-4236-8788-289622fc2c88", "tag": "5510c46b-9407-41b3-b02d-dbe7f958b08c"}, {"name": "network-changed", "server_uuid": "a2498a53-f6d8-4236-8788-289622fc2c88", "tag": "5510c46b-9407-41b3-b02d-dbe7f958b08c"}]} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:20:01.782368 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-57f9a502-9079-4b26-b968-08a690966570 req-b16a12d7-cae9-4b42-855c-c59f0d6adc31 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:20:01.782903 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-57f9a502-9079-4b26-b968-08a690966570 req-b16a12d7-cae9-4b42-855c-c59f0d6adc31 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:20:01.795917 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.compute.server_external_events [req-57f9a502-9079-4b26-b968-08a690966570 req-b16a12d7-cae9-4b42-855c-c59f0d6adc31 service nova] Creating event network-changed:5510c46b-9407-41b3-b02d-dbe7f958b08c for instance a2498a53-f6d8-4236-8788-289622fc2c88 on hv-cinder-maste Mar 31 18:20:01.796425 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.compute.server_external_events [req-57f9a502-9079-4b26-b968-08a690966570 req-b16a12d7-cae9-4b42-855c-c59f0d6adc31 service nova] Creating event network-changed:5510c46b-9407-41b3-b02d-dbe7f958b08c for instance a2498a53-f6d8-4236-8788-289622fc2c88 on hv-cinder-maste Mar 31 18:20:01.801745 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [req-57f9a502-9079-4b26-b968-08a690966570 req-b16a12d7-cae9-4b42-855c-c59f0d6adc31 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.033558 Mar 31 18:20:01.802339 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 296/601] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:20:01 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:20:57.005609 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-14121836-ca60-4acc-81c6-9fc77b611cab tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:20:57.006218 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-14121836-ca60-4acc-81c6-9fc77b611cab tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:20:57.012844 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-14121836-ca60-4acc-81c6-9fc77b611cab tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:20:57.013280 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-14121836-ca60-4acc-81c6-9fc77b611cab tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:20:57.014324 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-14121836-ca60-4acc-81c6-9fc77b611cab tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:20:57.014786 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-14121836-ca60-4acc-81c6-9fc77b611cab tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:20:57.042672 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-14121836-ca60-4acc-81c6-9fc77b611cab tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0/os-volume_attachments/2d153757-c590-4e61-aef7-f5684031e4f0" status: 200 len: 194 microversion: 2.20 time: 0.041893 Mar 31 18:20:57.043248 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 306/602] 10.222.0.58 () {60 vars in 1453 bytes} [Thu Mar 31 18:20:56 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0/os-volume_attachments/2d153757-c590-4e61-aef7-f5684031e4f0 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 31 18:20:57.107193 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-a9abbba7-ae23-423d-8079-aecf65c9195d tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:20:57.107751 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-a9abbba7-ae23-423d-8079-aecf65c9195d tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:20:57.113707 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a9abbba7-ae23-423d-8079-aecf65c9195d tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:20:57.114144 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a9abbba7-ae23-423d-8079-aecf65c9195d tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:20:57.114925 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a9abbba7-ae23-423d-8079-aecf65c9195d tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:20:57.115346 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a9abbba7-ae23-423d-8079-aecf65c9195d tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:20:57.236248 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.objects.instance [None req-a9abbba7-ae23-423d-8079-aecf65c9195d tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lazy-loading 'services' on Instance uuid 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 {{(pid=117539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 31 18:20:57.518992 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-a9abbba7-ae23-423d-8079-aecf65c9195d tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0/os-volume_attachments/2d153757-c590-4e61-aef7-f5684031e4f0" status: 202 len: 0 microversion: 2.20 time: 0.416034 Mar 31 18:20:57.519604 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 297/603] 10.222.0.58 () {60 vars in 1456 bytes} [Thu Mar 31 18:20:57 2022] DELETE /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0/os-volume_attachments/2d153757-c590-4e61-aef7-f5684031e4f0 => generated 0 bytes in 418 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 31 18:20:57.528067 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-1a4a794f-4c62-4eae-89b0-02543cf8c148 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:20:57.529903 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-1a4a794f-4c62-4eae-89b0-02543cf8c148 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:20:57.535054 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-1a4a794f-4c62-4eae-89b0-02543cf8c148 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:20:57.535500 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-1a4a794f-4c62-4eae-89b0-02543cf8c148 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:20:57.536254 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-1a4a794f-4c62-4eae-89b0-02543cf8c148 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:20:57.536687 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-1a4a794f-4c62-4eae-89b0-02543cf8c148 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:20:57.565218 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-1a4a794f-4c62-4eae-89b0-02543cf8c148 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041127 Mar 31 18:20:57.565699 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 307/604] 10.222.0.58 () {60 vars in 1342 bytes} [Thu Mar 31 18:20:57 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 31 18:20:58.578173 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-bb01543b-407d-4e26-bb4c-1ebebf945bab tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:20:58.579234 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-bb01543b-407d-4e26-bb4c-1ebebf945bab tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:20:58.586526 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-bb01543b-407d-4e26-bb4c-1ebebf945bab tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:20:58.586990 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-bb01543b-407d-4e26-bb4c-1ebebf945bab tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:20:58.587743 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-bb01543b-407d-4e26-bb4c-1ebebf945bab tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:20:58.588288 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-bb01543b-407d-4e26-bb4c-1ebebf945bab tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:20:58.618887 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-bb01543b-407d-4e26-bb4c-1ebebf945bab tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045096 Mar 31 18:20:58.619490 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 298/605] 10.222.0.58 () {60 vars in 1342 bytes} [Thu Mar 31 18:20:58 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 31 18:20:59.630919 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-21defb13-2042-4879-8467-65f1fd689085 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:20:59.631904 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-21defb13-2042-4879-8467-65f1fd689085 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:20:59.639382 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-21defb13-2042-4879-8467-65f1fd689085 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:20:59.639822 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-21defb13-2042-4879-8467-65f1fd689085 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:20:59.640568 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-21defb13-2042-4879-8467-65f1fd689085 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:20:59.640992 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-21defb13-2042-4879-8467-65f1fd689085 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:20:59.674917 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-21defb13-2042-4879-8467-65f1fd689085 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.048146 Mar 31 18:20:59.675469 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 308/606] 10.222.0.58 () {60 vars in 1342 bytes} [Thu Mar 31 18:20:59 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:20:59.731238 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-51f7befa-f475-4da1-9959-f63472e41410 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:20:59.731722 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-51f7befa-f475-4da1-9959-f63472e41410 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:20:59.737413 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-51f7befa-f475-4da1-9959-f63472e41410 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:20:59.737851 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-51f7befa-f475-4da1-9959-f63472e41410 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:20:59.738599 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-51f7befa-f475-4da1-9959-f63472e41410 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:20:59.739050 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-51f7befa-f475-4da1-9959-f63472e41410 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:20:59.762867 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-51f7befa-f475-4da1-9959-f63472e41410 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Going to try to terminate instance {{(pid=117539) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 31 18:21:00.068367 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-51f7befa-f475-4da1-9959-f63472e41410 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 204 len: 0 microversion: 2.20 time: 0.340605 Mar 31 18:21:00.069030 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 299/607] 10.222.0.58 () {60 vars in 1279 bytes} [Thu Mar 31 18:20:59 2022] DELETE /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 31 18:21:00.078123 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-e44f904b-7dda-4964-82e3-af94f41286c0 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:21:00.078818 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-e44f904b-7dda-4964-82e3-af94f41286c0 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:21:00.085776 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e44f904b-7dda-4964-82e3-af94f41286c0 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:00.086277 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e44f904b-7dda-4964-82e3-af94f41286c0 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:00.087212 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e44f904b-7dda-4964-82e3-af94f41286c0 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:00.087693 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e44f904b-7dda-4964-82e3-af94f41286c0 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:00.223676 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-e44f904b-7dda-4964-82e3-af94f41286c0 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:00.231891 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-e44f904b-7dda-4964-82e3-af94f41286c0 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:00.233390 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-e44f904b-7dda-4964-82e3-af94f41286c0 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:00.234628 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-e44f904b-7dda-4964-82e3-af94f41286c0 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1724 microversion: 2.20 time: 0.160515 Mar 31 18:21:00.235185 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 309/608] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:21:00 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:21:01.253854 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-666355ee-0f2c-4789-919e-b601d0616ca1 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:21:01.254535 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-666355ee-0f2c-4789-919e-b601d0616ca1 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:21:01.260637 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-666355ee-0f2c-4789-919e-b601d0616ca1 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:01.261323 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-666355ee-0f2c-4789-919e-b601d0616ca1 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:01.262081 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-666355ee-0f2c-4789-919e-b601d0616ca1 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:01.262497 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-666355ee-0f2c-4789-919e-b601d0616ca1 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:01.422779 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-666355ee-0f2c-4789-919e-b601d0616ca1 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:01.430733 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-666355ee-0f2c-4789-919e-b601d0616ca1 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:01.432217 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-666355ee-0f2c-4789-919e-b601d0616ca1 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:01.433347 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-666355ee-0f2c-4789-919e-b601d0616ca1 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1724 microversion: 2.20 time: 0.183854 Mar 31 18:21:01.433907 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 300/609] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:21:01 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1724 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:21:02.451304 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-c341fbbc-9f99-4e09-ba39-288060cce954 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:21:02.452034 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-c341fbbc-9f99-4e09-ba39-288060cce954 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:21:02.458308 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c341fbbc-9f99-4e09-ba39-288060cce954 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:02.458780 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c341fbbc-9f99-4e09-ba39-288060cce954 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:02.459711 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c341fbbc-9f99-4e09-ba39-288060cce954 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:02.460211 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c341fbbc-9f99-4e09-ba39-288060cce954 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:02.705911 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-c341fbbc-9f99-4e09-ba39-288060cce954 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:02.713984 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-c341fbbc-9f99-4e09-ba39-288060cce954 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:02.715508 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-c341fbbc-9f99-4e09-ba39-288060cce954 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:02.716664 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-c341fbbc-9f99-4e09-ba39-288060cce954 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1724 microversion: 2.20 time: 0.269418 Mar 31 18:21:02.717218 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 310/610] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:21:02 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1724 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:21:03.417168 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [req-cf14f2f5-fe6e-431d-af48-c2722cfca1ea req-f4f8af60-099b-43d5-84d4-8859b5bf2d28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0", "name": "network-vif-deleted", "tag": "3bfd294a-f954-4562-8fbf-0cd104ab3bee"}]} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:21:03.428430 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-cf14f2f5-fe6e-431d-af48-c2722cfca1ea req-f4f8af60-099b-43d5-84d4-8859b5bf2d28 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:03.430010 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-cf14f2f5-fe6e-431d-af48-c2722cfca1ea req-f4f8af60-099b-43d5-84d4-8859b5bf2d28 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:03.440126 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.compute.server_external_events [req-cf14f2f5-fe6e-431d-af48-c2722cfca1ea req-f4f8af60-099b-43d5-84d4-8859b5bf2d28 service nova] Creating event network-vif-deleted:3bfd294a-f954-4562-8fbf-0cd104ab3bee for instance 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 on hv-cinder-maste Mar 31 18:21:03.446013 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [req-cf14f2f5-fe6e-431d-af48-c2722cfca1ea req-f4f8af60-099b-43d5-84d4-8859b5bf2d28 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034581 Mar 31 18:21:03.446888 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 301/611] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:21:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:21:03.735421 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-bcce344f-2d76-411d-823b-8ee72537427b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:21:03.736037 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-bcce344f-2d76-411d-823b-8ee72537427b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:21:03.743548 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-bcce344f-2d76-411d-823b-8ee72537427b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:03.744330 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-bcce344f-2d76-411d-823b-8ee72537427b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:03.745135 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-bcce344f-2d76-411d-823b-8ee72537427b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:03.745564 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-bcce344f-2d76-411d-823b-8ee72537427b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:03.778765 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-bcce344f-2d76-411d-823b-8ee72537427b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:03.779208 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-bcce344f-2d76-411d-823b-8ee72537427b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:03.779657 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.objects.instance [None req-bcce344f-2d76-411d-823b-8ee72537427b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lazy-loading 'fault' on Instance uuid 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 {{(pid=117538) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 31 18:21:03.825090 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-bcce344f-2d76-411d-823b-8ee72537427b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:03.833396 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-bcce344f-2d76-411d-823b-8ee72537427b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:03.835670 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-bcce344f-2d76-411d-823b-8ee72537427b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:03.837043 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-bcce344f-2d76-411d-823b-8ee72537427b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 200 len: 1372 microversion: 2.20 time: 0.105681 Mar 31 18:21:03.838045 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 311/612] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:21:03 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 1372 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:21:04.855365 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-19d52e2a-b077-483a-b97f-92eac7526bf5 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:21:04.856056 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-19d52e2a-b077-483a-b97f-92eac7526bf5 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:21:04.862144 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-19d52e2a-b077-483a-b97f-92eac7526bf5 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:04.862590 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-19d52e2a-b077-483a-b97f-92eac7526bf5 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:04.863388 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-19d52e2a-b077-483a-b97f-92eac7526bf5 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:04.863824 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-19d52e2a-b077-483a-b97f-92eac7526bf5 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:04.877149 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.wsgi [None req-19d52e2a-b077-483a-b97f-92eac7526bf5 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] HTTP exception thrown: Instance 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 could not be found. Mar 31 18:21:04.877735 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-19d52e2a-b077-483a-b97f-92eac7526bf5 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Returning 404 to user: Instance 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 could not be found. {{(pid=117539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:21:04.878547 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-19d52e2a-b077-483a-b97f-92eac7526bf5 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 404 len: 111 microversion: 2.20 time: 0.027571 Mar 31 18:21:04.879351 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 302/613] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:21:04 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 31 18:21:04.890255 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-55e922ab-46b5-4463-8ed5-594c7f6e0a7a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '.version_select at 0x7fa4d427adc0>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:21:05.008081 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-55e922ab-46b5-4463-8ed5-594c7f6e0a7a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1288522538" status: 204 len: 0 microversion: 2.20 time: 0.123484 Mar 31 18:21:05.008703 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 312/614] 10.222.0.58 () {60 vars in 1261 bytes} [Thu Mar 31 18:21:04 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1288522538 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 31 18:21:05.820195 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-fd4f1ee8-3a3c-4150-af44-0e0a7ec95fb0 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Action: 'create', calling method: .version_select at 0x7fa4d43b6e50>, body: {"keypair": {"name": "tempest-keypair-1729630098"}} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:21:05.834783 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.quota [None req-fd4f1ee8-3a3c-4150-af44-0e0a7ec95fb0 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Getting quotas for project eb7248f2c93342cd823f385c53a69d05. Resources: {'key_pairs'} {{(pid=117539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 31 18:21:05.840626 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.quota [None req-fd4f1ee8-3a3c-4150-af44-0e0a7ec95fb0 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Getting quotas for user b1092332ac6040c597d28a4207c1ce86 and project eb7248f2c93342cd823f385c53a69d05. Resources: {'key_pairs'} {{(pid=117539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 31 18:21:06.188206 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.quota [None req-fd4f1ee8-3a3c-4150-af44-0e0a7ec95fb0 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Getting quotas for project eb7248f2c93342cd823f385c53a69d05. Resources: {'key_pairs'} {{(pid=117539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 31 18:21:06.192156 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.quota [None req-fd4f1ee8-3a3c-4150-af44-0e0a7ec95fb0 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Getting quotas for user b1092332ac6040c597d28a4207c1ce86 and project eb7248f2c93342cd823f385c53a69d05. Resources: {'key_pairs'} {{(pid=117539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 31 18:21:06.205428 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-fd4f1ee8-3a3c-4150-af44-0e0a7ec95fb0 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 201 len: 2316 microversion: 2.20 time: 0.390047 Mar 31 18:21:06.206016 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 303/615] 10.222.0.58 () {62 vars in 1198 bytes} [Thu Mar 31 18:21:05 2022] POST /compute/v2.1/os-keypairs => generated 2316 bytes in 391 msecs (HTTP/1.1 201) 9 headers in 365 bytes (1 switches on core 0) Mar 31 18:21:07.656671 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-58887883-1516-4fc9-ae9b-e5f21bbea2ac tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:21:07.657229 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-58887883-1516-4fc9-ae9b-e5f21bbea2ac tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: a2498a53-f6d8-4236-8788-289622fc2c88] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:21:07.664654 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-58887883-1516-4fc9-ae9b-e5f21bbea2ac tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:07.665113 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-58887883-1516-4fc9-ae9b-e5f21bbea2ac tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:07.665889 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-58887883-1516-4fc9-ae9b-e5f21bbea2ac tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:07.666319 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-58887883-1516-4fc9-ae9b-e5f21bbea2ac tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:07.748753 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.objects.instance [None req-58887883-1516-4fc9-ae9b-e5f21bbea2ac tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lazy-loading 'services' on Instance uuid a2498a53-f6d8-4236-8788-289622fc2c88 {{(pid=117538) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 31 18:21:08.080889 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-58887883-1516-4fc9-ae9b-e5f21bbea2ac tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88/os-volume_attachments/d8adbe01-d460-446c-bf13-348f060af096" status: 202 len: 0 microversion: 2.1 time: 0.428421 Mar 31 18:21:08.083293 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 313/616] 10.222.0.58 () {58 vars in 1415 bytes} [Thu Mar 31 18:21:07 2022] DELETE /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88/os-volume_attachments/d8adbe01-d460-446c-bf13-348f060af096 => generated 0 bytes in 430 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 31 18:21:08.090120 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-e1bfcdaf-806f-4c60-9373-2c1e397b75c4 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:21:08.091059 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-e1bfcdaf-806f-4c60-9373-2c1e397b75c4 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: a2498a53-f6d8-4236-8788-289622fc2c88] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:21:08.097464 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e1bfcdaf-806f-4c60-9373-2c1e397b75c4 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:08.097894 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e1bfcdaf-806f-4c60-9373-2c1e397b75c4 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:08.098672 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e1bfcdaf-806f-4c60-9373-2c1e397b75c4 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:08.099093 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e1bfcdaf-806f-4c60-9373-2c1e397b75c4 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:08.127184 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-e1bfcdaf-806f-4c60-9373-2c1e397b75c4 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041044 Mar 31 18:21:08.127765 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 304/617] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Mar 31 18:21:08 2022] GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 31 18:21:08.918151 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-bea4f869-4e37-4145-b0f3-bfcd7d3587ef tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-720845908", "imageRef": "6241b999-6f6d-4076-88bc-345fa7386256", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "b654ebd8-4c33-443d-bee5-4bafdafcd132"}], "security_groups": [{"name": "tempest-securitygroup--2055135246"}], "key_name": "tempest-keypair-1729630098", "user_data": "}} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:21:09.020509 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.network.neutron [None req-bea4f869-4e37-4145-b0f3-bfcd7d3587ef tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] validate_networks() for [('b654ebd8-4c33-443d-bee5-4bafdafcd132', None, None, None, None, None)] {{(pid=117538) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 31 18:21:09.140634 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-c9db014a-69dc-4be9-9b9c-461f90c85504 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:21:09.141547 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-c9db014a-69dc-4be9-9b9c-461f90c85504 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: a2498a53-f6d8-4236-8788-289622fc2c88] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:21:09.148089 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c9db014a-69dc-4be9-9b9c-461f90c85504 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:09.158694 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c9db014a-69dc-4be9-9b9c-461f90c85504 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:09.158694 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c9db014a-69dc-4be9-9b9c-461f90c85504 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:09.158694 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c9db014a-69dc-4be9-9b9c-461f90c85504 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:09.177709 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-c9db014a-69dc-4be9-9b9c-461f90c85504 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.040905 Mar 31 18:21:09.178345 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 305/618] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Mar 31 18:21:09 2022] GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88/os-volume_attachments => generated 197 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 31 18:21:09.447580 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.virt.hardware [None req-bea4f869-4e37-4145-b0f3-bfcd7d3587ef tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Flavor limits 0:0:0 {{(pid=117538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 31 18:21:09.448058 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.virt.hardware [None req-bea4f869-4e37-4145-b0f3-bfcd7d3587ef tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Image limits 0:0:0 {{(pid=117538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 31 18:21:09.448585 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.virt.hardware [None req-bea4f869-4e37-4145-b0f3-bfcd7d3587ef tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Flavor pref 0:0:0 {{(pid=117538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 31 18:21:09.448989 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.virt.hardware [None req-bea4f869-4e37-4145-b0f3-bfcd7d3587ef tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Image pref 0:0:0 {{(pid=117538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 31 18:21:09.449401 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.virt.hardware [None req-bea4f869-4e37-4145-b0f3-bfcd7d3587ef tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 31 18:21:09.458900 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-bea4f869-4e37-4145-b0f3-bfcd7d3587ef tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:09.473876 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-bea4f869-4e37-4145-b0f3-bfcd7d3587ef tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:09.473876 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-bea4f869-4e37-4145-b0f3-bfcd7d3587ef tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:09.473876 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-bea4f869-4e37-4145-b0f3-bfcd7d3587ef tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:09.477329 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.quota [None req-bea4f869-4e37-4145-b0f3-bfcd7d3587ef tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Getting quotas for project eb7248f2c93342cd823f385c53a69d05. Resources: {'instances', 'ram', 'cores'} {{(pid=117538) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 31 18:21:09.481122 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.quota [None req-bea4f869-4e37-4145-b0f3-bfcd7d3587ef tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Getting quotas for user b1092332ac6040c597d28a4207c1ce86 and project eb7248f2c93342cd823f385c53a69d05. Resources: {'instances', 'ram', 'cores'} {{(pid=117538) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 31 18:21:09.492884 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-bea4f869-4e37-4145-b0f3-bfcd7d3587ef tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Going to run 1 instances... {{(pid=117538) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 31 18:21:09.495207 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-bea4f869-4e37-4145-b0f3-bfcd7d3587ef tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6241b999-6f6d-4076-88bc-345fa7386256',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117538) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 31 18:21:09.607213 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-bea4f869-4e37-4145-b0f3-bfcd7d3587ef tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.695110 Mar 31 18:21:09.607895 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 314/619] 10.222.0.58 () {62 vars in 1187 bytes} [Thu Mar 31 18:21:08 2022] POST /compute/v2.1/servers => generated 402 bytes in 697 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Mar 31 18:21:09.618309 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-f8899677-5090-4524-9557-650933e395f4 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:21:09.618937 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-f8899677-5090-4524-9557-650933e395f4 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:21:09.670803 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-f8899677-5090-4524-9557-650933e395f4 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:09.678385 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-f8899677-5090-4524-9557-650933e395f4 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:09.680286 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-f8899677-5090-4524-9557-650933e395f4 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:09.681448 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-f8899677-5090-4524-9557-650933e395f4 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1281 microversion: 2.20 time: 0.067521 Mar 31 18:21:09.682097 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 306/620] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:21:09 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1281 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:21:10.189013 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-e1d9f8d7-be9e-4961-9795-97834cd0da74 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:21:10.189991 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-e1d9f8d7-be9e-4961-9795-97834cd0da74 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: a2498a53-f6d8-4236-8788-289622fc2c88] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:21:10.197415 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e1d9f8d7-be9e-4961-9795-97834cd0da74 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:10.198512 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e1d9f8d7-be9e-4961-9795-97834cd0da74 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:10.198667 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e1d9f8d7-be9e-4961-9795-97834cd0da74 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:10.199066 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e1d9f8d7-be9e-4961-9795-97834cd0da74 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:10.227439 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-e1d9f8d7-be9e-4961-9795-97834cd0da74 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042419 Mar 31 18:21:10.228008 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 315/621] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Mar 31 18:21:10 2022] GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 31 18:21:10.298602 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-8505ba82-23f5-4e43-854a-5c40a9898538 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:21:10.299191 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-8505ba82-23f5-4e43-854a-5c40a9898538 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: a2498a53-f6d8-4236-8788-289622fc2c88] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:21:10.305190 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-8505ba82-23f5-4e43-854a-5c40a9898538 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:10.310885 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-8505ba82-23f5-4e43-854a-5c40a9898538 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:10.310885 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-8505ba82-23f5-4e43-854a-5c40a9898538 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:10.311138 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-8505ba82-23f5-4e43-854a-5c40a9898538 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:10.336330 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-8505ba82-23f5-4e43-854a-5c40a9898538 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: a2498a53-f6d8-4236-8788-289622fc2c88] Going to try to terminate instance {{(pid=117539) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 31 18:21:10.662917 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-8505ba82-23f5-4e43-854a-5c40a9898538 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "DELETE /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88" status: 204 len: 0 microversion: 2.1 time: 0.367810 Mar 31 18:21:10.663508 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 307/622] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Mar 31 18:21:10 2022] DELETE /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 31 18:21:10.671474 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-40aba778-841a-4a82-9885-178d82e688c4 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:21:10.672227 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-40aba778-841a-4a82-9885-178d82e688c4 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: a2498a53-f6d8-4236-8788-289622fc2c88] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:21:10.677975 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-40aba778-841a-4a82-9885-178d82e688c4 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:10.678436 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-40aba778-841a-4a82-9885-178d82e688c4 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:10.679281 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-40aba778-841a-4a82-9885-178d82e688c4 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:10.679715 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-40aba778-841a-4a82-9885-178d82e688c4 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:10.700483 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-c9b67be0-342b-4904-aaef-788b2947e3e9 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:21:10.701172 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-c9b67be0-342b-4904-aaef-788b2947e3e9 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:21:10.706926 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c9b67be0-342b-4904-aaef-788b2947e3e9 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:10.707360 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c9b67be0-342b-4904-aaef-788b2947e3e9 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:10.712591 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c9b67be0-342b-4904-aaef-788b2947e3e9 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:10.712591 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c9b67be0-342b-4904-aaef-788b2947e3e9 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:10.775883 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-c9b67be0-342b-4904-aaef-788b2947e3e9 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:10.783678 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-c9b67be0-342b-4904-aaef-788b2947e3e9 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:10.785233 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-c9b67be0-342b-4904-aaef-788b2947e3e9 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:10.786320 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-c9b67be0-342b-4904-aaef-788b2947e3e9 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1285 microversion: 2.20 time: 0.090130 Mar 31 18:21:10.786905 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 308/623] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:21:10 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 31 18:21:10.829397 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-40aba778-841a-4a82-9885-178d82e688c4 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:10.837751 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-40aba778-841a-4a82-9885-178d82e688c4 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88" status: 200 len: 1688 microversion: 2.1 time: 0.170100 Mar 31 18:21:10.838302 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 316/624] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:21:10 2022] GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88 => generated 1688 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:21:11.804196 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-dea41fee-e552-4236-8a2c-e58d1a30689e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:21:11.804803 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-dea41fee-e552-4236-8a2c-e58d1a30689e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:21:11.810466 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-dea41fee-e552-4236-8a2c-e58d1a30689e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:11.810932 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-dea41fee-e552-4236-8a2c-e58d1a30689e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:11.811715 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-dea41fee-e552-4236-8a2c-e58d1a30689e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:11.812138 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-dea41fee-e552-4236-8a2c-e58d1a30689e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:11.855233 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-dd18506b-c073-4476-867a-d969b088bb33 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:21:11.855967 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-dd18506b-c073-4476-867a-d969b088bb33 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: a2498a53-f6d8-4236-8788-289622fc2c88] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:21:11.873621 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-dea41fee-e552-4236-8a2c-e58d1a30689e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:11.874133 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-dd18506b-c073-4476-867a-d969b088bb33 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:11.874585 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-dd18506b-c073-4476-867a-d969b088bb33 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:11.875399 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-dd18506b-c073-4476-867a-d969b088bb33 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:11.875828 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-dd18506b-c073-4476-867a-d969b088bb33 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:11.881958 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-dea41fee-e552-4236-8a2c-e58d1a30689e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:11.891867 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-dea41fee-e552-4236-8a2c-e58d1a30689e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:11.901311 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-dea41fee-e552-4236-8a2c-e58d1a30689e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1341 microversion: 2.20 time: 0.093311 Mar 31 18:21:11.901311 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 309/625] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:21:11 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1341 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:21:12.116920 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-dd18506b-c073-4476-867a-d969b088bb33 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:12.124854 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-dd18506b-c073-4476-867a-d969b088bb33 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88" status: 200 len: 1688 microversion: 2.1 time: 0.274390 Mar 31 18:21:12.125411 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 317/626] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:21:11 2022] GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88 => generated 1688 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:21:12.913129 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-b38faeb9-71a3-4f28-b94f-8f131ac1aba2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:21:12.913712 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-b38faeb9-71a3-4f28-b94f-8f131ac1aba2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:21:12.919421 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b38faeb9-71a3-4f28-b94f-8f131ac1aba2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:12.919854 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b38faeb9-71a3-4f28-b94f-8f131ac1aba2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:12.920597 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b38faeb9-71a3-4f28-b94f-8f131ac1aba2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:12.921019 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b38faeb9-71a3-4f28-b94f-8f131ac1aba2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:13.076335 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-b38faeb9-71a3-4f28-b94f-8f131ac1aba2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:13.085870 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-b38faeb9-71a3-4f28-b94f-8f131ac1aba2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:13.087787 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-b38faeb9-71a3-4f28-b94f-8f131ac1aba2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:13.089109 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-b38faeb9-71a3-4f28-b94f-8f131ac1aba2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1407 microversion: 2.20 time: 0.180595 Mar 31 18:21:13.096898 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 310/627] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:21:12 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1407 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:21:13.142117 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-cca5e6fa-8427-421a-bc28-fc6e24981031 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:21:13.142913 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-cca5e6fa-8427-421a-bc28-fc6e24981031 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: a2498a53-f6d8-4236-8788-289622fc2c88] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:21:13.149481 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-cca5e6fa-8427-421a-bc28-fc6e24981031 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:13.149917 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-cca5e6fa-8427-421a-bc28-fc6e24981031 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:13.150931 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-cca5e6fa-8427-421a-bc28-fc6e24981031 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:13.151487 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-cca5e6fa-8427-421a-bc28-fc6e24981031 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:13.328715 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-cca5e6fa-8427-421a-bc28-fc6e24981031 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:13.336499 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-cca5e6fa-8427-421a-bc28-fc6e24981031 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88" status: 200 len: 1688 microversion: 2.1 time: 0.198441 Mar 31 18:21:13.337026 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 318/628] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:21:13 2022] GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88 => generated 1688 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:21:13.391557 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [req-6880afa8-94fc-4237-9fc2-73e3e135f9c6 req-96197e4f-e3a9-40c6-ada7-21e84a17070d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e404c053-bc21-4cf0-9ba6-07e6971e588f", "tag": "af48c6cc-61d7-40f4-85b0-60adf2267642"}]} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:21:13.404451 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-6880afa8-94fc-4237-9fc2-73e3e135f9c6 req-96197e4f-e3a9-40c6-ada7-21e84a17070d service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:13.404889 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-6880afa8-94fc-4237-9fc2-73e3e135f9c6 req-96197e4f-e3a9-40c6-ada7-21e84a17070d service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:13.416894 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.compute.server_external_events [req-6880afa8-94fc-4237-9fc2-73e3e135f9c6 req-96197e4f-e3a9-40c6-ada7-21e84a17070d service nova] Creating event network-changed:af48c6cc-61d7-40f4-85b0-60adf2267642 for instance e404c053-bc21-4cf0-9ba6-07e6971e588f on hv-cinder-maste Mar 31 18:21:13.421782 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [req-6880afa8-94fc-4237-9fc2-73e3e135f9c6 req-96197e4f-e3a9-40c6-ada7-21e84a17070d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042206 Mar 31 18:21:13.422374 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 311/629] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:21:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:21:14.108571 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-73a58abf-14eb-487c-85d9-6d450fb6f224 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:21:14.109177 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-73a58abf-14eb-487c-85d9-6d450fb6f224 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:21:14.115197 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-73a58abf-14eb-487c-85d9-6d450fb6f224 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:14.115824 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-73a58abf-14eb-487c-85d9-6d450fb6f224 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:14.116747 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-73a58abf-14eb-487c-85d9-6d450fb6f224 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:14.117256 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-73a58abf-14eb-487c-85d9-6d450fb6f224 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:14.280403 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-73a58abf-14eb-487c-85d9-6d450fb6f224 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:14.288950 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-73a58abf-14eb-487c-85d9-6d450fb6f224 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:14.290457 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-73a58abf-14eb-487c-85d9-6d450fb6f224 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:14.291554 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-73a58abf-14eb-487c-85d9-6d450fb6f224 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1407 microversion: 2.20 time: 0.186953 Mar 31 18:21:14.292111 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 319/630] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:21:14 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1407 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:21:14.354282 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-923cb578-da8b-4e4c-9149-b5a87497f15b tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:21:14.355032 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-923cb578-da8b-4e4c-9149-b5a87497f15b tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: a2498a53-f6d8-4236-8788-289622fc2c88] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:21:14.361164 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-923cb578-da8b-4e4c-9149-b5a87497f15b tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:14.361627 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-923cb578-da8b-4e4c-9149-b5a87497f15b tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:14.362381 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-923cb578-da8b-4e4c-9149-b5a87497f15b tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:14.362862 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-923cb578-da8b-4e4c-9149-b5a87497f15b tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:14.502297 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-923cb578-da8b-4e4c-9149-b5a87497f15b tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:14.510145 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-923cb578-da8b-4e4c-9149-b5a87497f15b tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88" status: 200 len: 1688 microversion: 2.1 time: 0.160651 Mar 31 18:21:14.510739 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 312/631] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:21:14 2022] GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88 => generated 1688 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:21:15.310132 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-b34f3f04-4b7b-4002-aafc-9c58dcd6afc3 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:21:15.310814 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-b34f3f04-4b7b-4002-aafc-9c58dcd6afc3 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:21:15.316605 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b34f3f04-4b7b-4002-aafc-9c58dcd6afc3 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:15.317111 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b34f3f04-4b7b-4002-aafc-9c58dcd6afc3 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:15.317930 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b34f3f04-4b7b-4002-aafc-9c58dcd6afc3 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:15.318530 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b34f3f04-4b7b-4002-aafc-9c58dcd6afc3 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:15.524083 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-b34f3f04-4b7b-4002-aafc-9c58dcd6afc3 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:15.527870 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-34047935-684b-4c9d-af8f-57baaaf7aa75 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:21:15.528466 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-34047935-684b-4c9d-af8f-57baaaf7aa75 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: a2498a53-f6d8-4236-8788-289622fc2c88] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:21:15.533302 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-b34f3f04-4b7b-4002-aafc-9c58dcd6afc3 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:15.534741 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-34047935-684b-4c9d-af8f-57baaaf7aa75 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:15.534902 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-b34f3f04-4b7b-4002-aafc-9c58dcd6afc3 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:15.535183 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-34047935-684b-4c9d-af8f-57baaaf7aa75 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:15.535938 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-34047935-684b-4c9d-af8f-57baaaf7aa75 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:15.536065 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-b34f3f04-4b7b-4002-aafc-9c58dcd6afc3 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1407 microversion: 2.20 time: 0.230053 Mar 31 18:21:15.536362 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-34047935-684b-4c9d-af8f-57baaaf7aa75 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:15.546660 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 320/632] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:21:15 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1407 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:21:15.670471 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-34047935-684b-4c9d-af8f-57baaaf7aa75 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:15.679247 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-34047935-684b-4c9d-af8f-57baaaf7aa75 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88" status: 200 len: 1688 microversion: 2.1 time: 0.155000 Mar 31 18:21:15.679926 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 313/633] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:21:15 2022] GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88 => generated 1688 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:21:15.952457 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [req-e098b493-2b73-4b77-b943-f7ca29d9bbb7 req-069a7e68-e019-4853-b1c1-dcc855fdc080 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a2498a53-f6d8-4236-8788-289622fc2c88", "name": "network-vif-deleted", "tag": "5510c46b-9407-41b3-b02d-dbe7f958b08c"}]} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:21:15.961434 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-e098b493-2b73-4b77-b943-f7ca29d9bbb7 req-069a7e68-e019-4853-b1c1-dcc855fdc080 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:15.966516 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-e098b493-2b73-4b77-b943-f7ca29d9bbb7 req-069a7e68-e019-4853-b1c1-dcc855fdc080 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:15.973230 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.compute.server_external_events [req-e098b493-2b73-4b77-b943-f7ca29d9bbb7 req-069a7e68-e019-4853-b1c1-dcc855fdc080 service nova] Creating event network-vif-deleted:5510c46b-9407-41b3-b02d-dbe7f958b08c for instance a2498a53-f6d8-4236-8788-289622fc2c88 on hv-cinder-maste Mar 31 18:21:15.978230 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [req-e098b493-2b73-4b77-b943-f7ca29d9bbb7 req-069a7e68-e019-4853-b1c1-dcc855fdc080 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029410 Mar 31 18:21:15.978910 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 321/634] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:21:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:21:16.558657 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-4ca71bec-a90b-4fbd-82a1-806a1fd56f7f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:21:16.560889 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-4ca71bec-a90b-4fbd-82a1-806a1fd56f7f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:21:16.570464 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-4ca71bec-a90b-4fbd-82a1-806a1fd56f7f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:16.571052 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-4ca71bec-a90b-4fbd-82a1-806a1fd56f7f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:16.571911 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-4ca71bec-a90b-4fbd-82a1-806a1fd56f7f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:16.572612 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-4ca71bec-a90b-4fbd-82a1-806a1fd56f7f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:16.700083 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-18bafa02-d2dd-4130-b5e6-ba4eddeb66fe tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:21:16.700785 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-18bafa02-d2dd-4130-b5e6-ba4eddeb66fe tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: a2498a53-f6d8-4236-8788-289622fc2c88] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:21:16.711210 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-18bafa02-d2dd-4130-b5e6-ba4eddeb66fe tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:16.711933 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-18bafa02-d2dd-4130-b5e6-ba4eddeb66fe tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:16.712910 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-18bafa02-d2dd-4130-b5e6-ba4eddeb66fe tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:16.713543 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-18bafa02-d2dd-4130-b5e6-ba4eddeb66fe tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:16.727471 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-4ca71bec-a90b-4fbd-82a1-806a1fd56f7f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:16.736469 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-4ca71bec-a90b-4fbd-82a1-806a1fd56f7f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:16.738143 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-4ca71bec-a90b-4fbd-82a1-806a1fd56f7f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:16.739455 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-4ca71bec-a90b-4fbd-82a1-806a1fd56f7f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1407 microversion: 2.20 time: 0.185008 Mar 31 18:21:16.740213 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 314/635] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:21:16 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1407 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:21:16.757416 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-18bafa02-d2dd-4130-b5e6-ba4eddeb66fe tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:16.758014 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-18bafa02-d2dd-4130-b5e6-ba4eddeb66fe tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:16.758563 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.objects.instance [None req-18bafa02-d2dd-4130-b5e6-ba4eddeb66fe tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lazy-loading 'fault' on Instance uuid a2498a53-f6d8-4236-8788-289622fc2c88 {{(pid=117538) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 31 18:21:16.806757 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-18bafa02-d2dd-4130-b5e6-ba4eddeb66fe tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:16.813074 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-18bafa02-d2dd-4130-b5e6-ba4eddeb66fe tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88" status: 200 len: 1334 microversion: 2.1 time: 0.120129 Mar 31 18:21:16.813739 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 322/636] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:21:16 2022] GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88 => generated 1334 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:21:17.757556 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-82b04587-3b89-4ca6-887d-1ba2c39a8f72 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:21:17.758158 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-82b04587-3b89-4ca6-887d-1ba2c39a8f72 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:21:17.764219 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-82b04587-3b89-4ca6-887d-1ba2c39a8f72 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:17.764658 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-82b04587-3b89-4ca6-887d-1ba2c39a8f72 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:17.765412 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-82b04587-3b89-4ca6-887d-1ba2c39a8f72 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:17.765839 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-82b04587-3b89-4ca6-887d-1ba2c39a8f72 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:17.829954 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-1977ab0f-95cc-4e59-afcc-73f88f5a005a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:21:17.830549 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-1977ab0f-95cc-4e59-afcc-73f88f5a005a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: a2498a53-f6d8-4236-8788-289622fc2c88] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:21:17.837303 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-1977ab0f-95cc-4e59-afcc-73f88f5a005a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:17.837749 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-1977ab0f-95cc-4e59-afcc-73f88f5a005a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:17.838514 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-1977ab0f-95cc-4e59-afcc-73f88f5a005a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:17.838968 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-1977ab0f-95cc-4e59-afcc-73f88f5a005a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:17.852655 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.wsgi [None req-1977ab0f-95cc-4e59-afcc-73f88f5a005a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] HTTP exception thrown: Instance a2498a53-f6d8-4236-8788-289622fc2c88 could not be found. Mar 31 18:21:17.853374 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-1977ab0f-95cc-4e59-afcc-73f88f5a005a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Returning 404 to user: Instance a2498a53-f6d8-4236-8788-289622fc2c88 could not be found. {{(pid=117538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:21:17.854071 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-1977ab0f-95cc-4e59-afcc-73f88f5a005a tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88" status: 404 len: 111 microversion: 2.1 time: 0.027996 Mar 31 18:21:17.854650 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 323/637] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:21:17 2022] GET /compute/v2.1/servers/a2498a53-f6d8-4236-8788-289622fc2c88 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 31 18:21:17.862672 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-6d70d3b5-24b7-40cf-91e8-59a62b37b6c7 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '.version_select at 0x7fa4d42a71f0>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:21:17.905792 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-82b04587-3b89-4ca6-887d-1ba2c39a8f72 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:17.914632 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-82b04587-3b89-4ca6-887d-1ba2c39a8f72 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:17.916114 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-82b04587-3b89-4ca6-887d-1ba2c39a8f72 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:17.917253 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-82b04587-3b89-4ca6-887d-1ba2c39a8f72 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1407 microversion: 2.20 time: 0.163901 Mar 31 18:21:17.917795 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 315/638] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:21:17 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:21:17.989261 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-6d70d3b5-24b7-40cf-91e8-59a62b37b6c7 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-49036477" status: 202 len: 0 microversion: 2.1 time: 0.130379 Mar 31 18:21:17.989861 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 324/639] 10.222.0.58 () {58 vars in 1214 bytes} [Thu Mar 31 18:21:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-49036477 => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 31 18:21:18.935042 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-760648d9-5df3-4484-af91-81b00da33c34 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:21:18.935641 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-760648d9-5df3-4484-af91-81b00da33c34 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:21:18.941690 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-760648d9-5df3-4484-af91-81b00da33c34 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:18.942070 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-760648d9-5df3-4484-af91-81b00da33c34 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:18.942870 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-760648d9-5df3-4484-af91-81b00da33c34 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:18.943354 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-760648d9-5df3-4484-af91-81b00da33c34 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:19.081940 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-760648d9-5df3-4484-af91-81b00da33c34 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:19.089971 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-760648d9-5df3-4484-af91-81b00da33c34 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:19.091489 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-760648d9-5df3-4484-af91-81b00da33c34 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:19.092580 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-760648d9-5df3-4484-af91-81b00da33c34 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1407 microversion: 2.20 time: 0.161587 Mar 31 18:21:19.093138 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 316/640] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:21:18 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:21:20.111423 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-8d1f4b95-177d-44b0-84ac-078415e69029 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:21:20.112073 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-8d1f4b95-177d-44b0-84ac-078415e69029 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:21:20.119024 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8d1f4b95-177d-44b0-84ac-078415e69029 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:20.129445 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8d1f4b95-177d-44b0-84ac-078415e69029 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:20.129445 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8d1f4b95-177d-44b0-84ac-078415e69029 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:20.129445 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8d1f4b95-177d-44b0-84ac-078415e69029 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:20.251539 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-8d1f4b95-177d-44b0-84ac-078415e69029 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:20.259914 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-8d1f4b95-177d-44b0-84ac-078415e69029 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:20.261676 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-8d1f4b95-177d-44b0-84ac-078415e69029 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:20.262802 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-8d1f4b95-177d-44b0-84ac-078415e69029 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1407 microversion: 2.20 time: 0.155751 Mar 31 18:21:20.263350 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 325/641] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:21:20 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1407 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:21:20.676850 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [req-6836ca38-4469-4802-88a5-17671db9ae6c req-58ace6c1-51dd-4a89-83b0-9f75a55ea5f1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e404c053-bc21-4cf0-9ba6-07e6971e588f", "name": "network-vif-plugged", "status": "completed", "tag": "af48c6cc-61d7-40f4-85b0-60adf2267642"}]} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:21:20.685663 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-6836ca38-4469-4802-88a5-17671db9ae6c req-58ace6c1-51dd-4a89-83b0-9f75a55ea5f1 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:20.686102 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-6836ca38-4469-4802-88a5-17671db9ae6c req-58ace6c1-51dd-4a89-83b0-9f75a55ea5f1 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:20.698041 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.compute.server_external_events [req-6836ca38-4469-4802-88a5-17671db9ae6c req-58ace6c1-51dd-4a89-83b0-9f75a55ea5f1 service nova] Creating event network-vif-plugged:af48c6cc-61d7-40f4-85b0-60adf2267642 for instance e404c053-bc21-4cf0-9ba6-07e6971e588f on hv-cinder-maste Mar 31 18:21:20.703090 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [req-6836ca38-4469-4802-88a5-17671db9ae6c req-58ace6c1-51dd-4a89-83b0-9f75a55ea5f1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030059 Mar 31 18:21:20.703852 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 317/642] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:21:20 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 31 18:21:21.280588 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-ad396361-fe1b-4990-bdc6-0c5974df55c4 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:21:21.281192 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-ad396361-fe1b-4990-bdc6-0c5974df55c4 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:21:21.287952 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-ad396361-fe1b-4990-bdc6-0c5974df55c4 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:21.288390 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-ad396361-fe1b-4990-bdc6-0c5974df55c4 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:21.289145 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-ad396361-fe1b-4990-bdc6-0c5974df55c4 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:21.289573 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-ad396361-fe1b-4990-bdc6-0c5974df55c4 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:21.403371 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-b1b2151d-3216-4f07-b204-6466582fb308 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:21:21.403981 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-b1b2151d-3216-4f07-b204-6466582fb308 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:21:21.409923 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b1b2151d-3216-4f07-b204-6466582fb308 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:21.410361 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b1b2151d-3216-4f07-b204-6466582fb308 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:21.411164 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b1b2151d-3216-4f07-b204-6466582fb308 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:21.411595 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b1b2151d-3216-4f07-b204-6466582fb308 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:21.426092 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-ad396361-fe1b-4990-bdc6-0c5974df55c4 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:21.435146 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-ad396361-fe1b-4990-bdc6-0c5974df55c4 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:21.436667 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-ad396361-fe1b-4990-bdc6-0c5974df55c4 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:21.437772 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-b1b2151d-3216-4f07-b204-6466582fb308 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Going to try to terminate instance {{(pid=117539) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 31 18:21:21.437903 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-ad396361-fe1b-4990-bdc6-0c5974df55c4 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1407 microversion: 2.20 time: 0.161103 Mar 31 18:21:21.438372 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 326/643] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:21:21 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:21:21.759222 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-b1b2151d-3216-4f07-b204-6466582fb308 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "DELETE /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 204 len: 0 microversion: 2.1 time: 0.359732 Mar 31 18:21:21.759818 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 318/644] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Mar 31 18:21:21 2022] DELETE /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 31 18:21:21.767917 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-a5870fbd-2b33-4ee2-9a7f-8c1dbe911bd7 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:21:21.768522 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-a5870fbd-2b33-4ee2-9a7f-8c1dbe911bd7 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:21:21.775088 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a5870fbd-2b33-4ee2-9a7f-8c1dbe911bd7 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:21.775543 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a5870fbd-2b33-4ee2-9a7f-8c1dbe911bd7 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:21.776318 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a5870fbd-2b33-4ee2-9a7f-8c1dbe911bd7 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:21.776746 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a5870fbd-2b33-4ee2-9a7f-8c1dbe911bd7 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:21.912166 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-a5870fbd-2b33-4ee2-9a7f-8c1dbe911bd7 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:21.919504 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-a5870fbd-2b33-4ee2-9a7f-8c1dbe911bd7 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1507 microversion: 2.1 time: 0.155355 Mar 31 18:21:21.920263 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 327/645] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:21:21 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1507 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:21:22.456026 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-50d7e7ed-f575-4133-8299-30920fbb34dc tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:21:22.456703 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-50d7e7ed-f575-4133-8299-30920fbb34dc tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:21:22.462686 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-50d7e7ed-f575-4133-8299-30920fbb34dc tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:22.463127 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-50d7e7ed-f575-4133-8299-30920fbb34dc tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:22.463872 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-50d7e7ed-f575-4133-8299-30920fbb34dc tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:22.464320 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-50d7e7ed-f575-4133-8299-30920fbb34dc tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:22.599285 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-50d7e7ed-f575-4133-8299-30920fbb34dc tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:22.607562 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-50d7e7ed-f575-4133-8299-30920fbb34dc tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:22.609033 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-50d7e7ed-f575-4133-8299-30920fbb34dc tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:22.610107 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-50d7e7ed-f575-4133-8299-30920fbb34dc tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1407 microversion: 2.20 time: 0.158437 Mar 31 18:21:22.610672 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 319/646] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:21:22 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1407 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:21:22.936626 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-40fe6efa-5bd3-460e-839c-904189317228 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:21:22.937879 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-40fe6efa-5bd3-460e-839c-904189317228 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:21:22.944788 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-40fe6efa-5bd3-460e-839c-904189317228 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:22.945234 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-40fe6efa-5bd3-460e-839c-904189317228 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:22.946001 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-40fe6efa-5bd3-460e-839c-904189317228 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:22.946434 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-40fe6efa-5bd3-460e-839c-904189317228 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:23.441536 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-40fe6efa-5bd3-460e-839c-904189317228 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:23.449579 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-40fe6efa-5bd3-460e-839c-904189317228 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1507 microversion: 2.1 time: 0.516787 Mar 31 18:21:23.450147 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 328/647] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:21:22 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1507 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:21:23.628777 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-c4c191ea-3eb5-46bc-b3ad-570f91cb68c8 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:21:23.629381 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-c4c191ea-3eb5-46bc-b3ad-570f91cb68c8 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:21:23.638565 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c4c191ea-3eb5-46bc-b3ad-570f91cb68c8 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:23.639046 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c4c191ea-3eb5-46bc-b3ad-570f91cb68c8 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:23.639812 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c4c191ea-3eb5-46bc-b3ad-570f91cb68c8 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:23.640235 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c4c191ea-3eb5-46bc-b3ad-570f91cb68c8 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:23.697166 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [req-36d3c9f0-614f-4266-943e-58590757fe1a req-d2c78060-3471-44b1-9948-cd72923daa92 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "62ef59ed-5ec0-4452-9708-184340fa4f7f", "name": "network-vif-deleted", "tag": "9426b740-3eca-421b-a5c0-b9ab2601eebd"}]} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:21:23.705491 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-36d3c9f0-614f-4266-943e-58590757fe1a req-d2c78060-3471-44b1-9948-cd72923daa92 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:23.706938 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-36d3c9f0-614f-4266-943e-58590757fe1a req-d2c78060-3471-44b1-9948-cd72923daa92 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:23.722702 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.compute.server_external_events [req-36d3c9f0-614f-4266-943e-58590757fe1a req-d2c78060-3471-44b1-9948-cd72923daa92 service nova] Creating event network-vif-deleted:9426b740-3eca-421b-a5c0-b9ab2601eebd for instance 62ef59ed-5ec0-4452-9708-184340fa4f7f on hv-cinder-maste Mar 31 18:21:23.727873 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [req-36d3c9f0-614f-4266-943e-58590757fe1a req-d2c78060-3471-44b1-9948-cd72923daa92 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034879 Mar 31 18:21:23.728641 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 329/648] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:21:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 31 18:21:23.809612 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-c4c191ea-3eb5-46bc-b3ad-570f91cb68c8 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:23.817465 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-c4c191ea-3eb5-46bc-b3ad-570f91cb68c8 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:23.819121 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-c4c191ea-3eb5-46bc-b3ad-570f91cb68c8 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:23.820293 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-c4c191ea-3eb5-46bc-b3ad-570f91cb68c8 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1598 microversion: 2.20 time: 0.195469 Mar 31 18:21:23.820849 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 320/649] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:21:23 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1598 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:21:23.839122 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-59ca3b2d-4664-4eb1-97db-3d083637831e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:21:23.839693 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-59ca3b2d-4664-4eb1-97db-3d083637831e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:21:23.845837 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-59ca3b2d-4664-4eb1-97db-3d083637831e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:23.846285 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-59ca3b2d-4664-4eb1-97db-3d083637831e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:23.847767 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-59ca3b2d-4664-4eb1-97db-3d083637831e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:23.847767 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-59ca3b2d-4664-4eb1-97db-3d083637831e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:23.940580 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-59ca3b2d-4664-4eb1-97db-3d083637831e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.106537 Mar 31 18:21:23.944986 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 330/650] 10.222.0.58 () {60 vars in 1315 bytes} [Thu Mar 31 18:21:23 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f/os-interface => generated 284 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 31 18:21:24.466102 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-ff30b608-f879-4b7e-936a-412dd96f6ddd tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:21:24.470228 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-ff30b608-f879-4b7e-936a-412dd96f6ddd tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:21:24.472702 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ff30b608-f879-4b7e-936a-412dd96f6ddd tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:24.473136 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ff30b608-f879-4b7e-936a-412dd96f6ddd tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:24.473925 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ff30b608-f879-4b7e-936a-412dd96f6ddd tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:24.474346 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ff30b608-f879-4b7e-936a-412dd96f6ddd tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:24.503815 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ff30b608-f879-4b7e-936a-412dd96f6ddd tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:24.504242 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ff30b608-f879-4b7e-936a-412dd96f6ddd tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:24.507441 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.objects.instance [None req-ff30b608-f879-4b7e-936a-412dd96f6ddd tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lazy-loading 'fault' on Instance uuid 62ef59ed-5ec0-4452-9708-184340fa4f7f {{(pid=117539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 31 18:21:24.547660 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-ff30b608-f879-4b7e-936a-412dd96f6ddd tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:24.556528 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-ff30b608-f879-4b7e-936a-412dd96f6ddd tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 200 len: 1311 microversion: 2.1 time: 0.094282 Mar 31 18:21:24.557103 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 321/651] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:21:24 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 1311 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:21:25.574216 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-a029826e-faee-47d2-be45-aaabddf3eedf tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:21:25.574895 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-a029826e-faee-47d2-be45-aaabddf3eedf tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 62ef59ed-5ec0-4452-9708-184340fa4f7f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:21:25.580808 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a029826e-faee-47d2-be45-aaabddf3eedf tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:25.581295 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a029826e-faee-47d2-be45-aaabddf3eedf tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:25.582094 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a029826e-faee-47d2-be45-aaabddf3eedf tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:25.582530 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a029826e-faee-47d2-be45-aaabddf3eedf tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:25.596390 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.wsgi [None req-a029826e-faee-47d2-be45-aaabddf3eedf tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] HTTP exception thrown: Instance 62ef59ed-5ec0-4452-9708-184340fa4f7f could not be found. Mar 31 18:21:25.596973 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-a029826e-faee-47d2-be45-aaabddf3eedf tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Returning 404 to user: Instance 62ef59ed-5ec0-4452-9708-184340fa4f7f could not be found. {{(pid=117538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:21:25.597787 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-a029826e-faee-47d2-be45-aaabddf3eedf tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f" status: 404 len: 111 microversion: 2.1 time: 0.028063 Mar 31 18:21:25.598331 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 331/652] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:21:25 2022] GET /compute/v2.1/servers/62ef59ed-5ec0-4452-9708-184340fa4f7f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 31 18:21:25.607118 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-8706c0c1-82b9-4320-a842-f6010b3e3216 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:21:25.607681 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-8706c0c1-82b9-4320-a842-f6010b3e3216 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 779c13cd-7a7a-47b4-b488-0d1e365c3dc4] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:21:25.613466 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-8706c0c1-82b9-4320-a842-f6010b3e3216 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:25.613900 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-8706c0c1-82b9-4320-a842-f6010b3e3216 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:25.614698 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-8706c0c1-82b9-4320-a842-f6010b3e3216 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:25.615118 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-8706c0c1-82b9-4320-a842-f6010b3e3216 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:25.639972 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-8706c0c1-82b9-4320-a842-f6010b3e3216 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 779c13cd-7a7a-47b4-b488-0d1e365c3dc4] Going to try to terminate instance {{(pid=117539) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 31 18:21:25.742506 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [req-8520e49a-da51-4da0-93d2-f660b0c8d214 req-d14b4b62-11bc-42ce-8908-f23731737610 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e404c053-bc21-4cf0-9ba6-07e6971e588f", "tag": "af48c6cc-61d7-40f4-85b0-60adf2267642"}]} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:21:25.750431 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-8520e49a-da51-4da0-93d2-f660b0c8d214 req-d14b4b62-11bc-42ce-8908-f23731737610 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:25.751011 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-8520e49a-da51-4da0-93d2-f660b0c8d214 req-d14b4b62-11bc-42ce-8908-f23731737610 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:25.763088 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.compute.server_external_events [req-8520e49a-da51-4da0-93d2-f660b0c8d214 req-d14b4b62-11bc-42ce-8908-f23731737610 service nova] Creating event network-changed:af48c6cc-61d7-40f4-85b0-60adf2267642 for instance e404c053-bc21-4cf0-9ba6-07e6971e588f on hv-cinder-maste Mar 31 18:21:25.768114 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [req-8520e49a-da51-4da0-93d2-f660b0c8d214 req-d14b4b62-11bc-42ce-8908-f23731737610 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029436 Mar 31 18:21:25.769055 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 332/653] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:21:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 31 18:21:25.960609 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-8706c0c1-82b9-4320-a842-f6010b3e3216 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "DELETE /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4" status: 204 len: 0 microversion: 2.1 time: 0.355967 Mar 31 18:21:25.961188 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 322/654] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Mar 31 18:21:25 2022] DELETE /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 31 18:21:25.969997 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-3feccd24-69c1-408d-85eb-48162a567285 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:21:25.970850 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-3feccd24-69c1-408d-85eb-48162a567285 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 779c13cd-7a7a-47b4-b488-0d1e365c3dc4] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:21:25.977381 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3feccd24-69c1-408d-85eb-48162a567285 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:25.977833 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3feccd24-69c1-408d-85eb-48162a567285 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:25.978601 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3feccd24-69c1-408d-85eb-48162a567285 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:25.979069 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3feccd24-69c1-408d-85eb-48162a567285 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:26.208937 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-3feccd24-69c1-408d-85eb-48162a567285 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:26.217600 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-3feccd24-69c1-408d-85eb-48162a567285 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4" status: 200 len: 1520 microversion: 2.1 time: 0.251854 Mar 31 18:21:26.218171 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 333/655] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:21:25 2022] GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4 => generated 1520 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:21:27.235644 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-181236f4-3d75-4e2e-8f84-34f0dbb8c5b0 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:21:27.236333 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-181236f4-3d75-4e2e-8f84-34f0dbb8c5b0 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 779c13cd-7a7a-47b4-b488-0d1e365c3dc4] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:21:27.242198 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-181236f4-3d75-4e2e-8f84-34f0dbb8c5b0 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:27.242653 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-181236f4-3d75-4e2e-8f84-34f0dbb8c5b0 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:27.243434 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-181236f4-3d75-4e2e-8f84-34f0dbb8c5b0 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:27.243861 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-181236f4-3d75-4e2e-8f84-34f0dbb8c5b0 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:27.382023 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-181236f4-3d75-4e2e-8f84-34f0dbb8c5b0 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:27.389621 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-181236f4-3d75-4e2e-8f84-34f0dbb8c5b0 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4" status: 200 len: 1520 microversion: 2.1 time: 0.158140 Mar 31 18:21:27.390190 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 323/656] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:21:27 2022] GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:21:27.824870 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [req-ea8afcc9-7ced-4587-8aa5-a6cf5bca3716 req-f8af2bce-5455-4e9f-9957-596445bdc83e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "779c13cd-7a7a-47b4-b488-0d1e365c3dc4", "name": "network-vif-deleted", "tag": "a16d9c5f-04bd-414b-a468-f0a9a47b917b"}]} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:21:27.834828 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-ea8afcc9-7ced-4587-8aa5-a6cf5bca3716 req-f8af2bce-5455-4e9f-9957-596445bdc83e service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:27.835337 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-ea8afcc9-7ced-4587-8aa5-a6cf5bca3716 req-f8af2bce-5455-4e9f-9957-596445bdc83e service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:27.846850 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.compute.server_external_events [req-ea8afcc9-7ced-4587-8aa5-a6cf5bca3716 req-f8af2bce-5455-4e9f-9957-596445bdc83e service nova] Creating event network-vif-deleted:a16d9c5f-04bd-414b-a468-f0a9a47b917b for instance 779c13cd-7a7a-47b4-b488-0d1e365c3dc4 on hv-cinder-maste Mar 31 18:21:27.853193 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [req-ea8afcc9-7ced-4587-8aa5-a6cf5bca3716 req-f8af2bce-5455-4e9f-9957-596445bdc83e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031890 Mar 31 18:21:27.854095 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 334/657] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:21:28.407272 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-ade70214-c200-4288-ad22-47a13f5114bb tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:21:28.407858 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-ade70214-c200-4288-ad22-47a13f5114bb tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 779c13cd-7a7a-47b4-b488-0d1e365c3dc4] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:21:28.414443 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ade70214-c200-4288-ad22-47a13f5114bb tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:28.414918 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ade70214-c200-4288-ad22-47a13f5114bb tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:28.415675 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ade70214-c200-4288-ad22-47a13f5114bb tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:28.416107 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ade70214-c200-4288-ad22-47a13f5114bb tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:28.445568 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ade70214-c200-4288-ad22-47a13f5114bb tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:28.446011 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ade70214-c200-4288-ad22-47a13f5114bb tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:28.446456 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.objects.instance [None req-ade70214-c200-4288-ad22-47a13f5114bb tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lazy-loading 'fault' on Instance uuid 779c13cd-7a7a-47b4-b488-0d1e365c3dc4 {{(pid=117539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 31 18:21:28.486504 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-ade70214-c200-4288-ad22-47a13f5114bb tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6a93e87d6894cfd9b7948274f1d7b70', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6fc2eb72902a441ca6a6fa9350ce75f8', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:28.494005 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-ade70214-c200-4288-ad22-47a13f5114bb tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4" status: 200 len: 1310 microversion: 2.1 time: 0.090664 Mar 31 18:21:28.494572 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 324/658] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:21:28 2022] GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4 => generated 1310 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:21:29.513050 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-aa0f2fcb-bab9-4df8-a629-bdb4ef04ffe7 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:21:29.513791 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-aa0f2fcb-bab9-4df8-a629-bdb4ef04ffe7 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] [instance: 779c13cd-7a7a-47b4-b488-0d1e365c3dc4] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:21:29.519829 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-aa0f2fcb-bab9-4df8-a629-bdb4ef04ffe7 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:29.520266 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-aa0f2fcb-bab9-4df8-a629-bdb4ef04ffe7 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:29.521012 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-aa0f2fcb-bab9-4df8-a629-bdb4ef04ffe7 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:29.521480 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-aa0f2fcb-bab9-4df8-a629-bdb4ef04ffe7 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:29.534589 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.wsgi [None req-aa0f2fcb-bab9-4df8-a629-bdb4ef04ffe7 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] HTTP exception thrown: Instance 779c13cd-7a7a-47b4-b488-0d1e365c3dc4 could not be found. Mar 31 18:21:29.535178 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-aa0f2fcb-bab9-4df8-a629-bdb4ef04ffe7 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] Returning 404 to user: Instance 779c13cd-7a7a-47b4-b488-0d1e365c3dc4 could not be found. {{(pid=117538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:21:29.535966 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-aa0f2fcb-bab9-4df8-a629-bdb4ef04ffe7 tempest-ServerRescueNegativeTestJSON-1678622416 tempest-ServerRescueNegativeTestJSON-1678622416-project] 10.222.0.58 "GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4" status: 404 len: 111 microversion: 2.1 time: 0.027904 Mar 31 18:21:29.536476 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 335/659] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:21:29 2022] GET /compute/v2.1/servers/779c13cd-7a7a-47b4-b488-0d1e365c3dc4 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 31 18:21:41.236157 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-57557dd9-49a9-4bb9-b2a5-f3ebaf095537 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Action: 'create', calling method: .version_select at 0x7fa4d42d6e50>, body: {"keypair": {"name": "tempest-keypair-586943772"}} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:21:41.250074 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.quota [None req-57557dd9-49a9-4bb9-b2a5-f3ebaf095537 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Getting quotas for project 87baab8d37b040efbfe030d17be30823. Resources: {'key_pairs'} {{(pid=117539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 31 18:21:41.253701 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.quota [None req-57557dd9-49a9-4bb9-b2a5-f3ebaf095537 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Getting quotas for user c1a075de217449d9a941a7bc3c4c99c3 and project 87baab8d37b040efbfe030d17be30823. Resources: {'key_pairs'} {{(pid=117539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 31 18:21:41.432713 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.quota [None req-57557dd9-49a9-4bb9-b2a5-f3ebaf095537 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Getting quotas for project 87baab8d37b040efbfe030d17be30823. Resources: {'key_pairs'} {{(pid=117539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 31 18:21:41.436296 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.quota [None req-57557dd9-49a9-4bb9-b2a5-f3ebaf095537 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Getting quotas for user c1a075de217449d9a941a7bc3c4c99c3 and project 87baab8d37b040efbfe030d17be30823. Resources: {'key_pairs'} {{(pid=117539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 31 18:21:41.449550 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-57557dd9-49a9-4bb9-b2a5-f3ebaf095537 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.327963 Mar 31 18:21:41.450141 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 325/660] 10.222.0.58 () {60 vars in 1157 bytes} [Thu Mar 31 18:21:41 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:21:43.694909 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-d2299c99-ffcb-48a5-ab42-93fc73b9986b tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-667658405", "imageRef": "6241b999-6f6d-4076-88bc-345fa7386256", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4410ea83-4566-4c60-99ff-d1b5f30ec440"}], "security_groups": [{"name": "tempest-securitygroup--1706139522"}], "key_name": "tempest-keypair-586943772", "user_data": "}} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:21:43.832050 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.network.neutron [None req-d2299c99-ffcb-48a5-ab42-93fc73b9986b tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] validate_networks() for [('4410ea83-4566-4c60-99ff-d1b5f30ec440', None, None, None, None, None)] {{(pid=117538) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 31 18:21:44.222019 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.virt.hardware [None req-d2299c99-ffcb-48a5-ab42-93fc73b9986b tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Flavor limits 0:0:0 {{(pid=117538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 31 18:21:44.222432 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.virt.hardware [None req-d2299c99-ffcb-48a5-ab42-93fc73b9986b tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Image limits 0:0:0 {{(pid=117538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 31 18:21:44.222941 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.virt.hardware [None req-d2299c99-ffcb-48a5-ab42-93fc73b9986b tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Flavor pref 0:0:0 {{(pid=117538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 31 18:21:44.223341 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.virt.hardware [None req-d2299c99-ffcb-48a5-ab42-93fc73b9986b tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Image pref 0:0:0 {{(pid=117538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 31 18:21:44.223744 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.virt.hardware [None req-d2299c99-ffcb-48a5-ab42-93fc73b9986b tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 31 18:21:44.232712 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-d2299c99-ffcb-48a5-ab42-93fc73b9986b tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:44.233152 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-d2299c99-ffcb-48a5-ab42-93fc73b9986b tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:44.233943 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-d2299c99-ffcb-48a5-ab42-93fc73b9986b tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:44.234373 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-d2299c99-ffcb-48a5-ab42-93fc73b9986b tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:44.252862 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.quota [None req-d2299c99-ffcb-48a5-ab42-93fc73b9986b tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Getting quotas for project 87baab8d37b040efbfe030d17be30823. Resources: {'instances', 'ram', 'cores'} {{(pid=117538) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 31 18:21:44.257951 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.quota [None req-d2299c99-ffcb-48a5-ab42-93fc73b9986b tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Getting quotas for user c1a075de217449d9a941a7bc3c4c99c3 and project 87baab8d37b040efbfe030d17be30823. Resources: {'instances', 'ram', 'cores'} {{(pid=117538) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 31 18:21:44.269511 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-d2299c99-ffcb-48a5-ab42-93fc73b9986b tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Going to run 1 instances... {{(pid=117538) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 31 18:21:44.271988 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-d2299c99-ffcb-48a5-ab42-93fc73b9986b tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6241b999-6f6d-4076-88bc-345fa7386256',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117538) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 31 18:21:44.413420 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-d2299c99-ffcb-48a5-ab42-93fc73b9986b tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.723325 Mar 31 18:21:44.414641 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 336/661] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Mar 31 18:21:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 31 18:21:44.424584 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-86b6408f-7386-4eb8-8c7b-65ad97c9c786 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:21:44.427988 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-86b6408f-7386-4eb8-8c7b-65ad97c9c786 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:21:44.484431 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-86b6408f-7386-4eb8-8c7b-65ad97c9c786 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:44.497402 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-86b6408f-7386-4eb8-8c7b-65ad97c9c786 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58" status: 200 len: 1236 microversion: 2.1 time: 0.076601 Mar 31 18:21:44.508004 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 326/662] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:21:44 2022] GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58 => generated 1236 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:21:45.516395 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-8c37e4a1-34e9-4108-9efd-d47361b13a56 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:21:45.517088 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-8c37e4a1-34e9-4108-9efd-d47361b13a56 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:21:45.572620 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-8c37e4a1-34e9-4108-9efd-d47361b13a56 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:45.579337 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-8c37e4a1-34e9-4108-9efd-d47361b13a56 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58" status: 200 len: 1236 microversion: 2.1 time: 0.067404 Mar 31 18:21:45.579885 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 337/663] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:21:45 2022] GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58 => generated 1236 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:21:46.595628 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-9cba5e71-a23a-44c3-8d43-d9fe7d8ca1cf tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:21:46.596232 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-9cba5e71-a23a-44c3-8d43-d9fe7d8ca1cf tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:21:46.647819 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-9cba5e71-a23a-44c3-8d43-d9fe7d8ca1cf tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:46.654342 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-9cba5e71-a23a-44c3-8d43-d9fe7d8ca1cf tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58" status: 200 len: 1236 microversion: 2.1 time: 0.062608 Mar 31 18:21:46.654938 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 327/664] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:21:46 2022] GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58 => generated 1236 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:21:47.671257 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-5e85a1a5-a0df-4977-a4b8-380061ca96c4 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:21:47.671769 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-5e85a1a5-a0df-4977-a4b8-380061ca96c4 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:21:47.722390 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-5e85a1a5-a0df-4977-a4b8-380061ca96c4 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:47.728985 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-5e85a1a5-a0df-4977-a4b8-380061ca96c4 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58" status: 200 len: 1236 microversion: 2.1 time: 0.061677 Mar 31 18:21:47.729538 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 338/665] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:21:47 2022] GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58 => generated 1236 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:21:48.746195 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-1a01f078-7b9c-4c1a-95f7-381ac37bbfd9 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:21:48.747006 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-1a01f078-7b9c-4c1a-95f7-381ac37bbfd9 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:21:48.753104 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1a01f078-7b9c-4c1a-95f7-381ac37bbfd9 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:48.753548 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1a01f078-7b9c-4c1a-95f7-381ac37bbfd9 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:48.754327 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1a01f078-7b9c-4c1a-95f7-381ac37bbfd9 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:48.754795 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1a01f078-7b9c-4c1a-95f7-381ac37bbfd9 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:48.815892 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-1a01f078-7b9c-4c1a-95f7-381ac37bbfd9 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:48.824356 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-1a01f078-7b9c-4c1a-95f7-381ac37bbfd9 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58" status: 200 len: 1240 microversion: 2.1 time: 0.082054 Mar 31 18:21:48.824919 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 328/666] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:21:48 2022] GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58 => generated 1240 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:21:49.841476 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-74bd1e18-ed29-4349-926e-aaae216f28e8 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:21:49.842135 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-74bd1e18-ed29-4349-926e-aaae216f28e8 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:21:49.849141 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-74bd1e18-ed29-4349-926e-aaae216f28e8 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:49.849589 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-74bd1e18-ed29-4349-926e-aaae216f28e8 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:49.850349 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-74bd1e18-ed29-4349-926e-aaae216f28e8 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:49.850840 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-74bd1e18-ed29-4349-926e-aaae216f28e8 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:49.909661 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-74bd1e18-ed29-4349-926e-aaae216f28e8 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:49.917997 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-74bd1e18-ed29-4349-926e-aaae216f28e8 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58" status: 200 len: 1240 microversion: 2.1 time: 0.080273 Mar 31 18:21:49.922877 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 339/667] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:21:49 2022] GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58 => generated 1240 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:21:50.938346 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-32da5330-16ce-400a-8533-f2fa6451c924 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:21:50.938899 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-32da5330-16ce-400a-8533-f2fa6451c924 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:21:50.945183 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-32da5330-16ce-400a-8533-f2fa6451c924 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:50.945660 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-32da5330-16ce-400a-8533-f2fa6451c924 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:50.950702 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-32da5330-16ce-400a-8533-f2fa6451c924 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:50.950702 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-32da5330-16ce-400a-8533-f2fa6451c924 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:51.007951 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-32da5330-16ce-400a-8533-f2fa6451c924 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:51.015607 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-32da5330-16ce-400a-8533-f2fa6451c924 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58" status: 200 len: 1288 microversion: 2.1 time: 0.081190 Mar 31 18:21:51.016201 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 329/668] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:21:50 2022] GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58 => generated 1288 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:21:52.033408 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-6a856646-b1f6-4197-80f5-2134c47e5bff tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:21:52.033988 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-6a856646-b1f6-4197-80f5-2134c47e5bff tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:21:52.041881 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6a856646-b1f6-4197-80f5-2134c47e5bff tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:52.042331 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6a856646-b1f6-4197-80f5-2134c47e5bff tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:52.043175 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6a856646-b1f6-4197-80f5-2134c47e5bff tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:52.043608 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6a856646-b1f6-4197-80f5-2134c47e5bff tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:52.230286 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-6a856646-b1f6-4197-80f5-2134c47e5bff tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:52.238114 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-6a856646-b1f6-4197-80f5-2134c47e5bff tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58" status: 200 len: 1362 microversion: 2.1 time: 0.208638 Mar 31 18:21:52.238800 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 340/669] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:21:52 2022] GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58 => generated 1362 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:21:52.973712 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [req-f16c964f-8d22-426c-8309-34661ce8d9e6 req-f5a83077-b383-42b0-9b36-7cf21ff1146a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01ac6bc8-6406-46d8-b8a1-628449e68e58", "tag": "39569c59-56fb-4b13-b985-d8cf317000fa"}]} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:21:52.984010 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-f16c964f-8d22-426c-8309-34661ce8d9e6 req-f5a83077-b383-42b0-9b36-7cf21ff1146a service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:52.984466 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-f16c964f-8d22-426c-8309-34661ce8d9e6 req-f5a83077-b383-42b0-9b36-7cf21ff1146a service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:53.000044 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.compute.server_external_events [req-f16c964f-8d22-426c-8309-34661ce8d9e6 req-f5a83077-b383-42b0-9b36-7cf21ff1146a service nova] Creating event network-changed:39569c59-56fb-4b13-b985-d8cf317000fa for instance 01ac6bc8-6406-46d8-b8a1-628449e68e58 on hv-cinder-maste Mar 31 18:21:53.014653 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [req-f16c964f-8d22-426c-8309-34661ce8d9e6 req-f5a83077-b383-42b0-9b36-7cf21ff1146a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036504 Mar 31 18:21:53.014653 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 330/670] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:21:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:21:53.256056 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-b2532645-2633-463e-a513-17f0c880ccc9 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:21:53.256685 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-b2532645-2633-463e-a513-17f0c880ccc9 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:21:53.263848 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b2532645-2633-463e-a513-17f0c880ccc9 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:53.264373 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b2532645-2633-463e-a513-17f0c880ccc9 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:53.265286 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b2532645-2633-463e-a513-17f0c880ccc9 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:53.265744 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b2532645-2633-463e-a513-17f0c880ccc9 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:53.610047 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-b2532645-2633-463e-a513-17f0c880ccc9 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:53.617409 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-b2532645-2633-463e-a513-17f0c880ccc9 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58" status: 200 len: 1362 microversion: 2.1 time: 0.365263 Mar 31 18:21:53.618070 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 341/671] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:21:53 2022] GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58 => generated 1362 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:21:54.635482 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-d2aabe77-4d17-47d7-811e-0fab1adb9eae tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:21:54.636357 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-d2aabe77-4d17-47d7-811e-0fab1adb9eae tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:21:54.642436 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-d2aabe77-4d17-47d7-811e-0fab1adb9eae tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:54.642903 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-d2aabe77-4d17-47d7-811e-0fab1adb9eae tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:54.643645 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-d2aabe77-4d17-47d7-811e-0fab1adb9eae tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:54.644066 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-d2aabe77-4d17-47d7-811e-0fab1adb9eae tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:54.777209 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-d2aabe77-4d17-47d7-811e-0fab1adb9eae tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:54.784489 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-d2aabe77-4d17-47d7-811e-0fab1adb9eae tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58" status: 200 len: 1362 microversion: 2.1 time: 0.153475 Mar 31 18:21:54.785053 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 331/672] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:21:54 2022] GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58 => generated 1362 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:21:55.802665 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-48e3d1ab-567d-4b5f-a5ca-8c6422bfccd7 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:21:55.803276 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-48e3d1ab-567d-4b5f-a5ca-8c6422bfccd7 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:21:55.809501 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-48e3d1ab-567d-4b5f-a5ca-8c6422bfccd7 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:55.810086 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-48e3d1ab-567d-4b5f-a5ca-8c6422bfccd7 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:55.810870 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-48e3d1ab-567d-4b5f-a5ca-8c6422bfccd7 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:55.811296 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-48e3d1ab-567d-4b5f-a5ca-8c6422bfccd7 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:55.946757 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-48e3d1ab-567d-4b5f-a5ca-8c6422bfccd7 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:55.953988 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-48e3d1ab-567d-4b5f-a5ca-8c6422bfccd7 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58" status: 200 len: 1362 microversion: 2.1 time: 0.155469 Mar 31 18:21:55.954541 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 342/673] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:21:55 2022] GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58 => generated 1362 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:21:56.972109 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-1259661e-af46-421d-be49-af92b586541e tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:21:56.972819 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-1259661e-af46-421d-be49-af92b586541e tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:21:56.978918 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1259661e-af46-421d-be49-af92b586541e tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:56.979393 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1259661e-af46-421d-be49-af92b586541e tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:56.980144 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1259661e-af46-421d-be49-af92b586541e tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:56.980568 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1259661e-af46-421d-be49-af92b586541e tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:57.121119 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-1259661e-af46-421d-be49-af92b586541e tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:57.128294 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-1259661e-af46-421d-be49-af92b586541e tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58" status: 200 len: 1362 microversion: 2.1 time: 0.161107 Mar 31 18:21:57.128850 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 332/674] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:21:56 2022] GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58 => generated 1362 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:21:58.145310 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-eec9b42f-1fea-4d80-8ce3-ebd93c6912c7 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:21:58.145908 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-eec9b42f-1fea-4d80-8ce3-ebd93c6912c7 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:21:58.152327 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-eec9b42f-1fea-4d80-8ce3-ebd93c6912c7 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:58.157396 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-eec9b42f-1fea-4d80-8ce3-ebd93c6912c7 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:58.157396 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-eec9b42f-1fea-4d80-8ce3-ebd93c6912c7 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:58.157396 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-eec9b42f-1fea-4d80-8ce3-ebd93c6912c7 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:58.291308 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-eec9b42f-1fea-4d80-8ce3-ebd93c6912c7 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:58.298426 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-eec9b42f-1fea-4d80-8ce3-ebd93c6912c7 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58" status: 200 len: 1362 microversion: 2.1 time: 0.157005 Mar 31 18:21:58.299083 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 343/675] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:21:58 2022] GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58 => generated 1362 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:21:58.852439 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [req-08e294e4-66a8-4d1c-b421-ac1bef5d7cad req-9e9bb7c5-cb83-40c5-8209-5121c28e08df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01ac6bc8-6406-46d8-b8a1-628449e68e58", "name": "network-vif-plugged", "status": "completed", "tag": "39569c59-56fb-4b13-b985-d8cf317000fa"}]} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:21:58.860515 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-08e294e4-66a8-4d1c-b421-ac1bef5d7cad req-9e9bb7c5-cb83-40c5-8209-5121c28e08df service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:58.860925 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-08e294e4-66a8-4d1c-b421-ac1bef5d7cad req-9e9bb7c5-cb83-40c5-8209-5121c28e08df service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:58.872031 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.compute.server_external_events [req-08e294e4-66a8-4d1c-b421-ac1bef5d7cad req-9e9bb7c5-cb83-40c5-8209-5121c28e08df service nova] Creating event network-vif-plugged:39569c59-56fb-4b13-b985-d8cf317000fa for instance 01ac6bc8-6406-46d8-b8a1-628449e68e58 on hv-cinder-maste Mar 31 18:21:58.877131 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [req-08e294e4-66a8-4d1c-b421-ac1bef5d7cad req-9e9bb7c5-cb83-40c5-8209-5121c28e08df service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028539 Mar 31 18:21:58.882876 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 333/676] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:21:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:21:59.315249 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-bae423e4-a1dc-4d22-a5f9-12ce0a52ec07 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:21:59.315850 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-bae423e4-a1dc-4d22-a5f9-12ce0a52ec07 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:21:59.322808 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-bae423e4-a1dc-4d22-a5f9-12ce0a52ec07 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:59.323253 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-bae423e4-a1dc-4d22-a5f9-12ce0a52ec07 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:59.324017 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-bae423e4-a1dc-4d22-a5f9-12ce0a52ec07 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:21:59.324456 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-bae423e4-a1dc-4d22-a5f9-12ce0a52ec07 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:21:59.455662 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-bae423e4-a1dc-4d22-a5f9-12ce0a52ec07 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:21:59.463552 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-bae423e4-a1dc-4d22-a5f9-12ce0a52ec07 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58" status: 200 len: 1362 microversion: 2.1 time: 0.152199 Mar 31 18:21:59.464112 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 344/677] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:21:59 2022] GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58 => generated 1362 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:22:00.481772 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-0942a4c2-83da-492c-9f5f-b4b8b97fd976 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:00.482454 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-0942a4c2-83da-492c-9f5f-b4b8b97fd976 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:00.488501 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0942a4c2-83da-492c-9f5f-b4b8b97fd976 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:00.488930 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0942a4c2-83da-492c-9f5f-b4b8b97fd976 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:00.489666 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0942a4c2-83da-492c-9f5f-b4b8b97fd976 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:00.490088 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0942a4c2-83da-492c-9f5f-b4b8b97fd976 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:00.620140 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-0942a4c2-83da-492c-9f5f-b4b8b97fd976 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:00.627226 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-0942a4c2-83da-492c-9f5f-b4b8b97fd976 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58" status: 200 len: 1362 microversion: 2.1 time: 0.149668 Mar 31 18:22:00.627788 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 334/678] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:22:00 2022] GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58 => generated 1362 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:22:01.645593 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-b7a32b20-3a4c-424f-bbaa-bc371179bcc2 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:01.646136 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-b7a32b20-3a4c-424f-bbaa-bc371179bcc2 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:01.654919 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b7a32b20-3a4c-424f-bbaa-bc371179bcc2 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:01.655360 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b7a32b20-3a4c-424f-bbaa-bc371179bcc2 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:01.656128 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b7a32b20-3a4c-424f-bbaa-bc371179bcc2 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:01.656557 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b7a32b20-3a4c-424f-bbaa-bc371179bcc2 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:01.796508 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-b7a32b20-3a4c-424f-bbaa-bc371179bcc2 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:01.804818 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-b7a32b20-3a4c-424f-bbaa-bc371179bcc2 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58" status: 200 len: 1549 microversion: 2.1 time: 0.162896 Mar 31 18:22:01.805140 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 345/679] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:22:01 2022] GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58 => generated 1549 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:22:01.820925 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-449ae1f8-46d9-4cca-af23-207ff555091e tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:01.821481 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-449ae1f8-46d9-4cca-af23-207ff555091e tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:01.827407 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-449ae1f8-46d9-4cca-af23-207ff555091e tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:01.827843 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-449ae1f8-46d9-4cca-af23-207ff555091e tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:01.828593 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-449ae1f8-46d9-4cca-af23-207ff555091e tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:01.829042 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-449ae1f8-46d9-4cca-af23-207ff555091e tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:01.921729 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-449ae1f8-46d9-4cca-af23-207ff555091e tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.104533 Mar 31 18:22:01.922761 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 335/680] 10.222.0.58 () {58 vars in 1274 bytes} [Thu Mar 31 18:22:01 2022] GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:22:02.982619 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [req-f58e0213-157d-46f1-a598-b6759a8fc4ed req-ce2db642-0fe0-4b14-9bd3-73e39acf0511 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "01ac6bc8-6406-46d8-b8a1-628449e68e58", "tag": "39569c59-56fb-4b13-b985-d8cf317000fa"}]} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:22:02.991071 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-f58e0213-157d-46f1-a598-b6759a8fc4ed req-ce2db642-0fe0-4b14-9bd3-73e39acf0511 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:02.991561 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-f58e0213-157d-46f1-a598-b6759a8fc4ed req-ce2db642-0fe0-4b14-9bd3-73e39acf0511 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:03.004298 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.compute.server_external_events [req-f58e0213-157d-46f1-a598-b6759a8fc4ed req-ce2db642-0fe0-4b14-9bd3-73e39acf0511 service nova] Creating event network-changed:39569c59-56fb-4b13-b985-d8cf317000fa for instance 01ac6bc8-6406-46d8-b8a1-628449e68e58 on hv-cinder-maste Mar 31 18:22:03.010635 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [req-f58e0213-157d-46f1-a598-b6759a8fc4ed req-ce2db642-0fe0-4b14-9bd3-73e39acf0511 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031627 Mar 31 18:22:03.011619 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 346/681] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:22:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:22:03.972711 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 31 18:22:03.973282 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: Thu Mar 31 18:22:03 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 31 18:22:15.382288 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-3f3f8ef9-e38c-4d50-8ad3-d0696c18e87f tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:22:15.383067 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-3f3f8ef9-e38c-4d50-8ad3-d0696c18e87f tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:15.389616 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3f3f8ef9-e38c-4d50-8ad3-d0696c18e87f tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:15.390046 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3f3f8ef9-e38c-4d50-8ad3-d0696c18e87f tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:15.390976 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3f3f8ef9-e38c-4d50-8ad3-d0696c18e87f tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:15.391399 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3f3f8ef9-e38c-4d50-8ad3-d0696c18e87f tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:15.412558 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.objects.instance [None req-3f3f8ef9-e38c-4d50-8ad3-d0696c18e87f tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lazy-loading 'flavor' on Instance uuid 61abeff2-268a-4149-9962-497c409663ed {{(pid=117539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 31 18:22:15.662756 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-3f3f8ef9-e38c-4d50-8ad3-d0696c18e87f tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "POST /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed/action" status: 202 len: 0 microversion: 2.1 time: 0.284189 Mar 31 18:22:15.663263 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 336/682] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Mar 31 18:22:15 2022] POST /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed/action => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 31 18:22:15.673116 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-52ea200d-6c93-4b93-906b-37e8826824f8 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:15.673807 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-52ea200d-6c93-4b93-906b-37e8826824f8 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:15.679737 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-52ea200d-6c93-4b93-906b-37e8826824f8 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:15.680178 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-52ea200d-6c93-4b93-906b-37e8826824f8 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:15.680934 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-52ea200d-6c93-4b93-906b-37e8826824f8 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:15.681358 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-52ea200d-6c93-4b93-906b-37e8826824f8 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:15.821126 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-52ea200d-6c93-4b93-906b-37e8826824f8 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:15.828407 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-52ea200d-6c93-4b93-906b-37e8826824f8 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1567 microversion: 2.1 time: 0.160062 Mar 31 18:22:15.831409 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 347/683] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:22:15 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:22:16.846064 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-6ceda3fa-04f0-4999-9d12-8dbdd33ed310 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:16.846680 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-6ceda3fa-04f0-4999-9d12-8dbdd33ed310 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:16.853894 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-6ceda3fa-04f0-4999-9d12-8dbdd33ed310 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:16.854357 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-6ceda3fa-04f0-4999-9d12-8dbdd33ed310 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:16.855221 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-6ceda3fa-04f0-4999-9d12-8dbdd33ed310 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:16.855893 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-6ceda3fa-04f0-4999-9d12-8dbdd33ed310 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:17.001100 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-6ceda3fa-04f0-4999-9d12-8dbdd33ed310 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:17.008453 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-6ceda3fa-04f0-4999-9d12-8dbdd33ed310 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1567 microversion: 2.1 time: 0.166743 Mar 31 18:22:17.009009 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 337/684] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:22:16 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1567 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:22:18.026583 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-78c2225b-b7bc-413c-8c5d-b495a759793e tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:18.027354 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-78c2225b-b7bc-413c-8c5d-b495a759793e tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:18.033453 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-78c2225b-b7bc-413c-8c5d-b495a759793e tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:18.033896 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-78c2225b-b7bc-413c-8c5d-b495a759793e tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:18.034686 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-78c2225b-b7bc-413c-8c5d-b495a759793e tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:18.035124 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-78c2225b-b7bc-413c-8c5d-b495a759793e tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:18.170893 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-78c2225b-b7bc-413c-8c5d-b495a759793e tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:18.178567 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-78c2225b-b7bc-413c-8c5d-b495a759793e tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1567 microversion: 2.1 time: 0.156479 Mar 31 18:22:18.179186 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 348/685] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:22:18 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:22:19.196481 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-7bfb0544-e8d0-4edc-b127-7184ff4a686a tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:19.197079 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-7bfb0544-e8d0-4edc-b127-7184ff4a686a tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:19.203494 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-7bfb0544-e8d0-4edc-b127-7184ff4a686a tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:19.203928 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-7bfb0544-e8d0-4edc-b127-7184ff4a686a tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:19.204665 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-7bfb0544-e8d0-4edc-b127-7184ff4a686a tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:19.205085 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-7bfb0544-e8d0-4edc-b127-7184ff4a686a tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:19.339486 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-7bfb0544-e8d0-4edc-b127-7184ff4a686a tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:19.346867 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-7bfb0544-e8d0-4edc-b127-7184ff4a686a tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1567 microversion: 2.1 time: 0.154205 Mar 31 18:22:19.347428 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 338/686] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:22:19 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1567 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:22:20.364121 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-93874784-b01b-40f1-a7c9-461af8ff1005 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:20.364682 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-93874784-b01b-40f1-a7c9-461af8ff1005 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:20.370905 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-93874784-b01b-40f1-a7c9-461af8ff1005 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:20.371342 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-93874784-b01b-40f1-a7c9-461af8ff1005 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:20.372092 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-93874784-b01b-40f1-a7c9-461af8ff1005 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:20.372585 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-93874784-b01b-40f1-a7c9-461af8ff1005 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:20.513004 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-93874784-b01b-40f1-a7c9-461af8ff1005 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:20.520364 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-93874784-b01b-40f1-a7c9-461af8ff1005 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1567 microversion: 2.1 time: 0.160174 Mar 31 18:22:20.520923 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 349/687] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:22:20 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:22:21.537900 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-858c4590-583d-4638-84e9-8dfa4cc55dd7 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:21.538502 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-858c4590-583d-4638-84e9-8dfa4cc55dd7 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:21.544580 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-858c4590-583d-4638-84e9-8dfa4cc55dd7 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:21.545013 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-858c4590-583d-4638-84e9-8dfa4cc55dd7 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:21.545755 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-858c4590-583d-4638-84e9-8dfa4cc55dd7 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:21.546176 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-858c4590-583d-4638-84e9-8dfa4cc55dd7 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:21.683420 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-858c4590-583d-4638-84e9-8dfa4cc55dd7 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:21.690903 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-858c4590-583d-4638-84e9-8dfa4cc55dd7 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1567 microversion: 2.1 time: 0.156758 Mar 31 18:22:21.691459 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 339/688] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:22:21 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:22:22.708330 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-85efdf80-ee45-43da-909c-68813d244559 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:22.708938 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-85efdf80-ee45-43da-909c-68813d244559 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:22.715146 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-85efdf80-ee45-43da-909c-68813d244559 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:22.715591 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-85efdf80-ee45-43da-909c-68813d244559 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:22.716483 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-85efdf80-ee45-43da-909c-68813d244559 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:22.716910 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-85efdf80-ee45-43da-909c-68813d244559 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:22.850424 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-85efdf80-ee45-43da-909c-68813d244559 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:22.857814 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-85efdf80-ee45-43da-909c-68813d244559 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1567 microversion: 2.1 time: 0.153301 Mar 31 18:22:22.858375 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 350/689] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:22:22 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:22:23.874629 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-9492f074-1bae-42c4-bf93-e9193903aab8 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:23.875249 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-9492f074-1bae-42c4-bf93-e9193903aab8 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:23.881015 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9492f074-1bae-42c4-bf93-e9193903aab8 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:23.881456 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9492f074-1bae-42c4-bf93-e9193903aab8 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:23.882195 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9492f074-1bae-42c4-bf93-e9193903aab8 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:23.882639 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9492f074-1bae-42c4-bf93-e9193903aab8 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:24.016177 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-9492f074-1bae-42c4-bf93-e9193903aab8 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:24.023566 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-9492f074-1bae-42c4-bf93-e9193903aab8 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1567 microversion: 2.1 time: 0.152720 Mar 31 18:22:24.024128 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 340/690] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:22:23 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:22:25.040849 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-791c1bf0-c7fd-4a0f-af79-55514e302524 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:25.041488 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-791c1bf0-c7fd-4a0f-af79-55514e302524 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:25.048336 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-791c1bf0-c7fd-4a0f-af79-55514e302524 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:25.048777 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-791c1bf0-c7fd-4a0f-af79-55514e302524 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:25.049534 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-791c1bf0-c7fd-4a0f-af79-55514e302524 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:25.049968 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-791c1bf0-c7fd-4a0f-af79-55514e302524 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:25.185624 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-791c1bf0-c7fd-4a0f-af79-55514e302524 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:25.193107 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-791c1bf0-c7fd-4a0f-af79-55514e302524 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1567 microversion: 2.1 time: 0.156083 Mar 31 18:22:25.193671 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 351/691] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:22:25 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:22:26.210667 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-ada5ccf7-04c2-4a9d-8ced-112d98266732 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:26.211310 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-ada5ccf7-04c2-4a9d-8ced-112d98266732 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:26.217851 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ada5ccf7-04c2-4a9d-8ced-112d98266732 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:26.218295 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ada5ccf7-04c2-4a9d-8ced-112d98266732 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:26.219092 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ada5ccf7-04c2-4a9d-8ced-112d98266732 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:26.219521 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ada5ccf7-04c2-4a9d-8ced-112d98266732 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:26.359678 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-ada5ccf7-04c2-4a9d-8ced-112d98266732 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:26.367025 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-ada5ccf7-04c2-4a9d-8ced-112d98266732 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1567 microversion: 2.1 time: 0.160179 Mar 31 18:22:26.367589 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 341/692] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:22:26 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1567 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:22:26.592591 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-a3d24035-5ec7-41a9-a685-ffc4a2fed950 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:26.593145 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-a3d24035-5ec7-41a9-a685-ffc4a2fed950 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: 06c9b67d-f63b-4be1-ab26-18346902f6e3] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:26.599532 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a3d24035-5ec7-41a9-a685-ffc4a2fed950 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:26.599979 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a3d24035-5ec7-41a9-a685-ffc4a2fed950 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:26.600749 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a3d24035-5ec7-41a9-a685-ffc4a2fed950 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:26.601180 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a3d24035-5ec7-41a9-a685-ffc4a2fed950 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:26.627382 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-a3d24035-5ec7-41a9-a685-ffc4a2fed950 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: 06c9b67d-f63b-4be1-ab26-18346902f6e3] Going to try to terminate instance {{(pid=117538) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 31 18:22:27.009592 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-a3d24035-5ec7-41a9-a685-ffc4a2fed950 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "DELETE /compute/v2.1/servers/06c9b67d-f63b-4be1-ab26-18346902f6e3" status: 204 len: 0 microversion: 2.1 time: 0.420789 Mar 31 18:22:27.010183 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 352/693] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Mar 31 18:22:26 2022] DELETE /compute/v2.1/servers/06c9b67d-f63b-4be1-ab26-18346902f6e3 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 31 18:22:27.018684 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-fb488075-b484-43de-92df-fcb56a7eeb6f tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:27.020138 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-fb488075-b484-43de-92df-fcb56a7eeb6f tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: 06c9b67d-f63b-4be1-ab26-18346902f6e3] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:27.026046 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-fb488075-b484-43de-92df-fcb56a7eeb6f tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:27.026483 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-fb488075-b484-43de-92df-fcb56a7eeb6f tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:27.027261 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-fb488075-b484-43de-92df-fcb56a7eeb6f tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:27.027684 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-fb488075-b484-43de-92df-fcb56a7eeb6f tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:27.161375 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-fb488075-b484-43de-92df-fcb56a7eeb6f tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:27.168470 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-fb488075-b484-43de-92df-fcb56a7eeb6f tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/06c9b67d-f63b-4be1-ab26-18346902f6e3" status: 200 len: 1576 microversion: 2.1 time: 0.153783 Mar 31 18:22:27.169028 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 342/694] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:22:27 2022] GET /compute/v2.1/servers/06c9b67d-f63b-4be1-ab26-18346902f6e3 => generated 1576 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:22:27.383677 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-1bca162c-e2d0-43fe-81e6-b89132881bf6 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:27.384539 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-1bca162c-e2d0-43fe-81e6-b89132881bf6 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:27.391169 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-1bca162c-e2d0-43fe-81e6-b89132881bf6 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:27.391613 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-1bca162c-e2d0-43fe-81e6-b89132881bf6 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:27.392365 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-1bca162c-e2d0-43fe-81e6-b89132881bf6 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:27.392793 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-1bca162c-e2d0-43fe-81e6-b89132881bf6 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:27.530757 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-1bca162c-e2d0-43fe-81e6-b89132881bf6 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:27.538166 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-1bca162c-e2d0-43fe-81e6-b89132881bf6 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1567 microversion: 2.1 time: 0.158800 Mar 31 18:22:27.538754 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 353/695] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:22:27 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1567 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:22:28.187057 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-abd16872-2ff8-4d65-a210-ec1f8472081c tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:28.187679 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-abd16872-2ff8-4d65-a210-ec1f8472081c tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: 06c9b67d-f63b-4be1-ab26-18346902f6e3] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:28.193557 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-abd16872-2ff8-4d65-a210-ec1f8472081c tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:28.194037 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-abd16872-2ff8-4d65-a210-ec1f8472081c tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:28.194816 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-abd16872-2ff8-4d65-a210-ec1f8472081c tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:28.195235 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-abd16872-2ff8-4d65-a210-ec1f8472081c tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:28.330406 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-abd16872-2ff8-4d65-a210-ec1f8472081c tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:28.337737 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-abd16872-2ff8-4d65-a210-ec1f8472081c tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/06c9b67d-f63b-4be1-ab26-18346902f6e3" status: 200 len: 1576 microversion: 2.1 time: 0.155419 Mar 31 18:22:28.338295 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 343/696] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:22:28 2022] GET /compute/v2.1/servers/06c9b67d-f63b-4be1-ab26-18346902f6e3 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:22:28.561666 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-6e428cf3-473c-4dfc-ae0a-6baa34008006 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:28.562267 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-6e428cf3-473c-4dfc-ae0a-6baa34008006 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:28.567942 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6e428cf3-473c-4dfc-ae0a-6baa34008006 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:28.568378 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6e428cf3-473c-4dfc-ae0a-6baa34008006 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:28.569126 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6e428cf3-473c-4dfc-ae0a-6baa34008006 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:28.569547 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6e428cf3-473c-4dfc-ae0a-6baa34008006 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:28.704873 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-6e428cf3-473c-4dfc-ae0a-6baa34008006 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:28.712328 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-6e428cf3-473c-4dfc-ae0a-6baa34008006 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1567 microversion: 2.1 time: 0.154997 Mar 31 18:22:28.712896 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 354/697] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:22:28 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:22:29.355360 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-1bd796e7-77ca-462c-9367-5377dd80d67b tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:29.356192 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-1bd796e7-77ca-462c-9367-5377dd80d67b tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: 06c9b67d-f63b-4be1-ab26-18346902f6e3] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:29.362703 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1bd796e7-77ca-462c-9367-5377dd80d67b tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:29.366014 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1bd796e7-77ca-462c-9367-5377dd80d67b tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:29.366014 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1bd796e7-77ca-462c-9367-5377dd80d67b tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:29.366014 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1bd796e7-77ca-462c-9367-5377dd80d67b tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:29.509223 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-1bd796e7-77ca-462c-9367-5377dd80d67b tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:29.517675 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-1bd796e7-77ca-462c-9367-5377dd80d67b tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/06c9b67d-f63b-4be1-ab26-18346902f6e3" status: 200 len: 1576 microversion: 2.1 time: 0.166586 Mar 31 18:22:29.518248 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 344/698] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:22:29 2022] GET /compute/v2.1/servers/06c9b67d-f63b-4be1-ab26-18346902f6e3 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:22:29.729329 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-b4ded96c-fc8c-4250-a05f-448284a03505 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:29.729932 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-b4ded96c-fc8c-4250-a05f-448284a03505 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:29.737039 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b4ded96c-fc8c-4250-a05f-448284a03505 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:29.737476 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b4ded96c-fc8c-4250-a05f-448284a03505 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:29.738234 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b4ded96c-fc8c-4250-a05f-448284a03505 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:29.738688 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b4ded96c-fc8c-4250-a05f-448284a03505 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:29.956040 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-b4ded96c-fc8c-4250-a05f-448284a03505 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:29.963872 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-b4ded96c-fc8c-4250-a05f-448284a03505 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1568 microversion: 2.1 time: 0.238418 Mar 31 18:22:29.964459 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 355/699] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:22:29 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1568 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:22:29.981065 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-878b0518-94f3-432f-9b8e-7ab442686d5f tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:22:29.985751 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-878b0518-94f3-432f-9b8e-7ab442686d5f tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:29.989206 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-878b0518-94f3-432f-9b8e-7ab442686d5f tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:29.989647 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-878b0518-94f3-432f-9b8e-7ab442686d5f tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:29.990413 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-878b0518-94f3-432f-9b8e-7ab442686d5f tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:29.990869 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-878b0518-94f3-432f-9b8e-7ab442686d5f tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:30.173416 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-878b0518-94f3-432f-9b8e-7ab442686d5f tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "POST /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed/action" status: 202 len: 0 microversion: 2.1 time: 0.196081 Mar 31 18:22:30.175063 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 345/700] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Mar 31 18:22:29 2022] POST /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed/action => generated 0 bytes in 198 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 31 18:22:30.183504 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-b2dc0963-efca-43a4-8474-b985b40794ee tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:30.183938 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-b2dc0963-efca-43a4-8474-b985b40794ee tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:30.190407 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b2dc0963-efca-43a4-8474-b985b40794ee tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:30.190823 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b2dc0963-efca-43a4-8474-b985b40794ee tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:30.191803 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b2dc0963-efca-43a4-8474-b985b40794ee tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:30.192392 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b2dc0963-efca-43a4-8474-b985b40794ee tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:30.532489 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [req-e5fe7702-2894-4ac5-a35b-4c6e57bd3009 req-73d77be5-192a-4682-8e6b-a5f887f3359f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "06c9b67d-f63b-4be1-ab26-18346902f6e3", "name": "network-vif-deleted", "tag": "d73baa13-9b78-4d3b-b347-b15a781aadbe"}]} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:22:30.542653 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-b2dc0963-efca-43a4-8474-b985b40794ee tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:30.548056 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-e5fe7702-2894-4ac5-a35b-4c6e57bd3009 req-73d77be5-192a-4682-8e6b-a5f887f3359f service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:30.548502 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-e5fe7702-2894-4ac5-a35b-4c6e57bd3009 req-73d77be5-192a-4682-8e6b-a5f887f3359f service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:30.553382 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-b2dc0963-efca-43a4-8474-b985b40794ee tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1576 microversion: 2.1 time: 0.373679 Mar 31 18:22:30.554710 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 356/701] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:22:30 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1576 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:22:30.560741 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-42b952dc-4adb-4265-81f4-1187e83bc22c tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:30.561719 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-42b952dc-4adb-4265-81f4-1187e83bc22c tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: 06c9b67d-f63b-4be1-ab26-18346902f6e3] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:30.570483 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-42b952dc-4adb-4265-81f4-1187e83bc22c tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:30.571072 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-42b952dc-4adb-4265-81f4-1187e83bc22c tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:30.572160 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-42b952dc-4adb-4265-81f4-1187e83bc22c tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:30.572666 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-42b952dc-4adb-4265-81f4-1187e83bc22c tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:30.588150 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.compute.server_external_events [req-e5fe7702-2894-4ac5-a35b-4c6e57bd3009 req-73d77be5-192a-4682-8e6b-a5f887f3359f service nova] Creating event network-vif-deleted:d73baa13-9b78-4d3b-b347-b15a781aadbe for instance 06c9b67d-f63b-4be1-ab26-18346902f6e3 on hv-cinder-maste Mar 31 18:22:30.596584 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [req-e5fe7702-2894-4ac5-a35b-4c6e57bd3009 req-73d77be5-192a-4682-8e6b-a5f887f3359f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.066202 Mar 31 18:22:30.596584 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 346/702] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:22:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 31 18:22:30.664315 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-42b952dc-4adb-4265-81f4-1187e83bc22c tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:30.674031 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-42b952dc-4adb-4265-81f4-1187e83bc22c tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/06c9b67d-f63b-4be1-ab26-18346902f6e3" status: 200 len: 1509 microversion: 2.1 time: 0.118208 Mar 31 18:22:30.674700 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 357/703] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:22:30 2022] GET /compute/v2.1/servers/06c9b67d-f63b-4be1-ab26-18346902f6e3 => generated 1509 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:22:31.572484 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-22b3af36-14e3-4794-a6a6-78c32a6363c8 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:31.574993 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-22b3af36-14e3-4794-a6a6-78c32a6363c8 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:31.579973 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-22b3af36-14e3-4794-a6a6-78c32a6363c8 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:31.580445 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-22b3af36-14e3-4794-a6a6-78c32a6363c8 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:31.581397 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-22b3af36-14e3-4794-a6a6-78c32a6363c8 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:31.581848 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-22b3af36-14e3-4794-a6a6-78c32a6363c8 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:31.692775 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-8d05ea8a-8b65-4230-b4bb-29dfcc460ee0 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:31.694681 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-8d05ea8a-8b65-4230-b4bb-29dfcc460ee0 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: 06c9b67d-f63b-4be1-ab26-18346902f6e3] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:31.701723 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8d05ea8a-8b65-4230-b4bb-29dfcc460ee0 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:31.702161 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8d05ea8a-8b65-4230-b4bb-29dfcc460ee0 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:31.702958 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8d05ea8a-8b65-4230-b4bb-29dfcc460ee0 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:31.703387 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8d05ea8a-8b65-4230-b4bb-29dfcc460ee0 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:31.732320 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-22b3af36-14e3-4794-a6a6-78c32a6363c8 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:31.741787 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-22b3af36-14e3-4794-a6a6-78c32a6363c8 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1518 microversion: 2.1 time: 0.173605 Mar 31 18:22:31.746094 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 347/704] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:22:31 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1518 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:22:31.746243 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8d05ea8a-8b65-4230-b4bb-29dfcc460ee0 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:31.746243 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8d05ea8a-8b65-4230-b4bb-29dfcc460ee0 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:31.746243 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.objects.instance [None req-8d05ea8a-8b65-4230-b4bb-29dfcc460ee0 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lazy-loading 'fault' on Instance uuid 06c9b67d-f63b-4be1-ab26-18346902f6e3 {{(pid=117538) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 31 18:22:31.789170 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-8d05ea8a-8b65-4230-b4bb-29dfcc460ee0 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:31.797536 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-8d05ea8a-8b65-4230-b4bb-29dfcc460ee0 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/06c9b67d-f63b-4be1-ab26-18346902f6e3" status: 200 len: 1230 microversion: 2.1 time: 0.109555 Mar 31 18:22:31.803312 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 358/705] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:22:31 2022] GET /compute/v2.1/servers/06c9b67d-f63b-4be1-ab26-18346902f6e3 => generated 1230 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:22:32.761644 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-cc3cc527-6a53-4818-b1a9-3c53527fb65a tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:32.762919 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-cc3cc527-6a53-4818-b1a9-3c53527fb65a tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:32.769139 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-cc3cc527-6a53-4818-b1a9-3c53527fb65a tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:32.772492 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-cc3cc527-6a53-4818-b1a9-3c53527fb65a tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:32.772492 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-cc3cc527-6a53-4818-b1a9-3c53527fb65a tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:32.772492 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-cc3cc527-6a53-4818-b1a9-3c53527fb65a tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:32.817628 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-7316a79f-e017-403c-9eec-ed10682fcb67 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:32.818965 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-7316a79f-e017-403c-9eec-ed10682fcb67 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: 06c9b67d-f63b-4be1-ab26-18346902f6e3] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:32.825496 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-7316a79f-e017-403c-9eec-ed10682fcb67 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:32.826235 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-7316a79f-e017-403c-9eec-ed10682fcb67 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:32.827138 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-7316a79f-e017-403c-9eec-ed10682fcb67 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:32.827635 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-7316a79f-e017-403c-9eec-ed10682fcb67 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:32.845783 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.wsgi [None req-7316a79f-e017-403c-9eec-ed10682fcb67 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] HTTP exception thrown: Instance 06c9b67d-f63b-4be1-ab26-18346902f6e3 could not be found. Mar 31 18:22:32.846765 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-7316a79f-e017-403c-9eec-ed10682fcb67 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Returning 404 to user: Instance 06c9b67d-f63b-4be1-ab26-18346902f6e3 could not be found. {{(pid=117538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:22:32.848796 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-7316a79f-e017-403c-9eec-ed10682fcb67 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/06c9b67d-f63b-4be1-ab26-18346902f6e3" status: 404 len: 111 microversion: 2.1 time: 0.034782 Mar 31 18:22:32.849587 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 359/706] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:22:32 2022] GET /compute/v2.1/servers/06c9b67d-f63b-4be1-ab26-18346902f6e3 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 31 18:22:32.915757 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [req-4fe7c375-4d8e-4de7-824c-fc540ca0105d req-afff19fa-9e3d-43c7-a7e3-f2eb7b42e46d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61abeff2-268a-4149-9962-497c409663ed", "name": "network-vif-unplugged", "status": "completed", "tag": "156f9ff9-ec0d-4ac3-a7d7-2fa14dbead9a"}]} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:22:32.934382 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-4fe7c375-4d8e-4de7-824c-fc540ca0105d req-afff19fa-9e3d-43c7-a7e3-f2eb7b42e46d service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:32.934925 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-4fe7c375-4d8e-4de7-824c-fc540ca0105d req-afff19fa-9e3d-43c7-a7e3-f2eb7b42e46d service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:32.943814 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-cc3cc527-6a53-4818-b1a9-3c53527fb65a tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:32.949947 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.compute.server_external_events [req-4fe7c375-4d8e-4de7-824c-fc540ca0105d req-afff19fa-9e3d-43c7-a7e3-f2eb7b42e46d service nova] Creating event network-vif-unplugged:156f9ff9-ec0d-4ac3-a7d7-2fa14dbead9a for instance 61abeff2-268a-4149-9962-497c409663ed on hv-cinder-maste Mar 31 18:22:32.952046 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-cc3cc527-6a53-4818-b1a9-3c53527fb65a tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1518 microversion: 2.1 time: 0.194462 Mar 31 18:22:32.952607 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 348/707] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:22:32 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1518 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:22:32.957983 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [req-4fe7c375-4d8e-4de7-824c-fc540ca0105d req-afff19fa-9e3d-43c7-a7e3-f2eb7b42e46d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.046420 Mar 31 18:22:32.958802 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 360/708] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:22:32 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 31 18:22:32.960638 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-ab541386-af93-4db7-83cf-82053dbd398a tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-928565273", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-270850616", "security_groups": [{"name": "tempest-secgroup-smoke-532749938"}], "block_device_mapping_v2": [{"uuid": "4f06148f-c3da-48e9-b5d5-ed1f835ff060", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "46cf5202-8790-480a-a14a-b087639c31e2"}]}} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:22:33.076127 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.network.neutron [None req-ab541386-af93-4db7-83cf-82053dbd398a tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] validate_networks() for [('46cf5202-8790-480a-a14a-b087639c31e2', None, None, None, None, None)] {{(pid=117539) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 31 18:22:33.676541 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.virt.hardware [None req-ab541386-af93-4db7-83cf-82053dbd398a tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Flavor limits 0:0:0 {{(pid=117539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 31 18:22:33.676978 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.virt.hardware [None req-ab541386-af93-4db7-83cf-82053dbd398a tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Image limits 0:0:0 {{(pid=117539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 31 18:22:33.677446 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.virt.hardware [None req-ab541386-af93-4db7-83cf-82053dbd398a tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Flavor pref 0:0:0 {{(pid=117539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 31 18:22:33.678009 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.virt.hardware [None req-ab541386-af93-4db7-83cf-82053dbd398a tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Image pref 0:0:0 {{(pid=117539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 31 18:22:33.678419 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.virt.hardware [None req-ab541386-af93-4db7-83cf-82053dbd398a tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 31 18:22:33.686939 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ab541386-af93-4db7-83cf-82053dbd398a tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:33.687385 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ab541386-af93-4db7-83cf-82053dbd398a tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:33.688266 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ab541386-af93-4db7-83cf-82053dbd398a tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:33.688689 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ab541386-af93-4db7-83cf-82053dbd398a tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:33.706149 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.quota [None req-ab541386-af93-4db7-83cf-82053dbd398a tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Getting quotas for project 70f0b3390f4542c8831753ecf26f6745. Resources: {'instances', 'ram', 'cores'} {{(pid=117539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 31 18:22:33.709979 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.quota [None req-ab541386-af93-4db7-83cf-82053dbd398a tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Getting quotas for user 7c5ea90eba174068877cdcc1594ccda4 and project 70f0b3390f4542c8831753ecf26f6745. Resources: {'instances', 'ram', 'cores'} {{(pid=117539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 31 18:22:33.766356 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-ab541386-af93-4db7-83cf-82053dbd398a tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Going to run 1 instances... {{(pid=117539) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 31 18:22:33.768790 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-ab541386-af93-4db7-83cf-82053dbd398a tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: 635a0e04-c990-4a66-81ed-ab572007484b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='4f06148f-c3da-48e9-b5d5-ed1f835ff060',volume_size=None,volume_type=None)] {{(pid=117539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 31 18:22:33.972264 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-3b5d40f4-2d7c-49cb-9034-34c12f242901 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:33.975361 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-3b5d40f4-2d7c-49cb-9034-34c12f242901 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:33.979166 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3b5d40f4-2d7c-49cb-9034-34c12f242901 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:33.979600 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3b5d40f4-2d7c-49cb-9034-34c12f242901 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:33.980356 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3b5d40f4-2d7c-49cb-9034-34c12f242901 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:33.980781 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3b5d40f4-2d7c-49cb-9034-34c12f242901 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:34.120417 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-3b5d40f4-2d7c-49cb-9034-34c12f242901 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:34.128189 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-3b5d40f4-2d7c-49cb-9034-34c12f242901 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1574 microversion: 2.1 time: 0.162272 Mar 31 18:22:34.128771 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 361/709] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:22:33 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1574 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:22:34.234737 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-ab541386-af93-4db7-83cf-82053dbd398a tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.278179 Mar 31 18:22:34.235474 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 349/710] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Mar 31 18:22:32 2022] POST /compute/v2.1/servers => generated 405 bytes in 1280 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 31 18:22:34.245567 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-b0aba670-a1f5-417f-8ae1-df2d1f1b089c tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:34.246208 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-b0aba670-a1f5-417f-8ae1-df2d1f1b089c tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: 635a0e04-c990-4a66-81ed-ab572007484b] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:34.304159 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-b0aba670-a1f5-417f-8ae1-df2d1f1b089c tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:34.310660 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-b0aba670-a1f5-417f-8ae1-df2d1f1b089c tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/635a0e04-c990-4a66-81ed-ab572007484b" status: 200 len: 1093 microversion: 2.1 time: 0.069035 Mar 31 18:22:34.311244 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 362/711] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:22:34 2022] GET /compute/v2.1/servers/635a0e04-c990-4a66-81ed-ab572007484b => generated 1093 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:22:35.145966 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-c59761ab-aa88-4de8-9e9b-d8f4f44e0b32 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:35.146574 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-c59761ab-aa88-4de8-9e9b-d8f4f44e0b32 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:35.152703 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c59761ab-aa88-4de8-9e9b-d8f4f44e0b32 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:35.153149 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c59761ab-aa88-4de8-9e9b-d8f4f44e0b32 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:35.153909 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c59761ab-aa88-4de8-9e9b-d8f4f44e0b32 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:35.154393 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c59761ab-aa88-4de8-9e9b-d8f4f44e0b32 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:35.288664 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-c59761ab-aa88-4de8-9e9b-d8f4f44e0b32 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:35.296272 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-c59761ab-aa88-4de8-9e9b-d8f4f44e0b32 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1574 microversion: 2.1 time: 0.155093 Mar 31 18:22:35.298756 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 350/712] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:22:35 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:22:35.333139 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-fd989191-1400-4c2b-b495-c0db69096fb6 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:35.333139 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-fd989191-1400-4c2b-b495-c0db69096fb6 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: 635a0e04-c990-4a66-81ed-ab572007484b] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:35.335415 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-fd989191-1400-4c2b-b495-c0db69096fb6 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:35.335861 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-fd989191-1400-4c2b-b495-c0db69096fb6 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:35.336615 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-fd989191-1400-4c2b-b495-c0db69096fb6 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:35.337045 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-fd989191-1400-4c2b-b495-c0db69096fb6 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:35.395442 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-fd989191-1400-4c2b-b495-c0db69096fb6 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:35.403081 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-fd989191-1400-4c2b-b495-c0db69096fb6 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/635a0e04-c990-4a66-81ed-ab572007484b" status: 200 len: 1143 microversion: 2.1 time: 0.079229 Mar 31 18:22:35.403840 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 363/713] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:22:35 2022] GET /compute/v2.1/servers/635a0e04-c990-4a66-81ed-ab572007484b => generated 1143 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:22:36.313504 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-a8552f0c-e709-4177-a5b1-4897f0479511 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:36.314071 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-a8552f0c-e709-4177-a5b1-4897f0479511 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:36.320177 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a8552f0c-e709-4177-a5b1-4897f0479511 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:36.320617 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a8552f0c-e709-4177-a5b1-4897f0479511 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:36.321504 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a8552f0c-e709-4177-a5b1-4897f0479511 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:36.321937 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a8552f0c-e709-4177-a5b1-4897f0479511 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:36.420077 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-f801264e-c205-4282-be0f-58123b921960 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:36.420692 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-f801264e-c205-4282-be0f-58123b921960 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: 635a0e04-c990-4a66-81ed-ab572007484b] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:36.427382 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f801264e-c205-4282-be0f-58123b921960 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:36.427833 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f801264e-c205-4282-be0f-58123b921960 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:36.429955 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f801264e-c205-4282-be0f-58123b921960 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:36.429955 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f801264e-c205-4282-be0f-58123b921960 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:36.468656 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-a8552f0c-e709-4177-a5b1-4897f0479511 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:36.476737 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-a8552f0c-e709-4177-a5b1-4897f0479511 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1574 microversion: 2.1 time: 0.167228 Mar 31 18:22:36.477303 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 351/714] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:22:36 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1574 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:22:36.506390 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-f801264e-c205-4282-be0f-58123b921960 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:36.513992 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-f801264e-c205-4282-be0f-58123b921960 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/635a0e04-c990-4a66-81ed-ab572007484b" status: 200 len: 1199 microversion: 2.1 time: 0.097700 Mar 31 18:22:36.514588 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 364/715] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:22:36 2022] GET /compute/v2.1/servers/635a0e04-c990-4a66-81ed-ab572007484b => generated 1199 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:22:37.493387 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-db8aae28-8c8f-41f9-8a54-bfe1c131fcf6 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:37.494030 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-db8aae28-8c8f-41f9-8a54-bfe1c131fcf6 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:37.499894 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-db8aae28-8c8f-41f9-8a54-bfe1c131fcf6 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:37.500327 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-db8aae28-8c8f-41f9-8a54-bfe1c131fcf6 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:37.501076 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-db8aae28-8c8f-41f9-8a54-bfe1c131fcf6 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:37.501500 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-db8aae28-8c8f-41f9-8a54-bfe1c131fcf6 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:37.532561 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-0d5b89dd-e17a-47e0-acd7-79f2a24dd2fa tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:37.533283 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-0d5b89dd-e17a-47e0-acd7-79f2a24dd2fa tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: 635a0e04-c990-4a66-81ed-ab572007484b] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:37.540584 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-0d5b89dd-e17a-47e0-acd7-79f2a24dd2fa tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:37.541856 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-0d5b89dd-e17a-47e0-acd7-79f2a24dd2fa tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:37.545344 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-0d5b89dd-e17a-47e0-acd7-79f2a24dd2fa tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:37.545942 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-0d5b89dd-e17a-47e0-acd7-79f2a24dd2fa tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:37.652438 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-db8aae28-8c8f-41f9-8a54-bfe1c131fcf6 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:37.660628 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-db8aae28-8c8f-41f9-8a54-bfe1c131fcf6 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1574 microversion: 2.1 time: 0.170939 Mar 31 18:22:37.661408 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 352/716] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:22:37 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1574 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:22:38.031539 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-0d5b89dd-e17a-47e0-acd7-79f2a24dd2fa tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:38.040357 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-0d5b89dd-e17a-47e0-acd7-79f2a24dd2fa tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/635a0e04-c990-4a66-81ed-ab572007484b" status: 200 len: 1276 microversion: 2.1 time: 0.512208 Mar 31 18:22:38.040921 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 365/717] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:22:37 2022] GET /compute/v2.1/servers/635a0e04-c990-4a66-81ed-ab572007484b => generated 1276 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:22:38.460438 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [req-4c42a678-66f0-42e8-92ae-51c871b18b27 req-dd19c340-e2d1-4ef1-8480-3fa7ce24fd2b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "635a0e04-c990-4a66-81ed-ab572007484b", "tag": "8009d02e-5d59-48da-9d8c-071ba781cd76"}]} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:22:38.472661 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-4c42a678-66f0-42e8-92ae-51c871b18b27 req-dd19c340-e2d1-4ef1-8480-3fa7ce24fd2b service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:38.473114 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-4c42a678-66f0-42e8-92ae-51c871b18b27 req-dd19c340-e2d1-4ef1-8480-3fa7ce24fd2b service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:38.485188 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.compute.server_external_events [req-4c42a678-66f0-42e8-92ae-51c871b18b27 req-dd19c340-e2d1-4ef1-8480-3fa7ce24fd2b service nova] Creating event network-changed:8009d02e-5d59-48da-9d8c-071ba781cd76 for instance 635a0e04-c990-4a66-81ed-ab572007484b on hv-cinder-maste Mar 31 18:22:38.491002 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [req-4c42a678-66f0-42e8-92ae-51c871b18b27 req-dd19c340-e2d1-4ef1-8480-3fa7ce24fd2b service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034740 Mar 31 18:22:38.491928 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 353/718] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:22:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:22:38.679485 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-8a151aa6-0f5e-440d-9ce8-930fab1b5b1a tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:38.680202 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-8a151aa6-0f5e-440d-9ce8-930fab1b5b1a tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:38.687575 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8a151aa6-0f5e-440d-9ce8-930fab1b5b1a tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:38.688181 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8a151aa6-0f5e-440d-9ce8-930fab1b5b1a tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:38.688961 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8a151aa6-0f5e-440d-9ce8-930fab1b5b1a tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:38.689504 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8a151aa6-0f5e-440d-9ce8-930fab1b5b1a tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:38.899348 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-8a151aa6-0f5e-440d-9ce8-930fab1b5b1a tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:38.906551 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-8a151aa6-0f5e-440d-9ce8-930fab1b5b1a tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1574 microversion: 2.1 time: 0.232126 Mar 31 18:22:38.907138 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 366/719] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:22:38 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1574 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:22:39.058355 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-0d0a0d43-2b90-4efd-890f-196a972c128b tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:39.059659 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-0d0a0d43-2b90-4efd-890f-196a972c128b tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: 635a0e04-c990-4a66-81ed-ab572007484b] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:39.065869 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0d0a0d43-2b90-4efd-890f-196a972c128b tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:39.067083 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0d0a0d43-2b90-4efd-890f-196a972c128b tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:39.067847 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0d0a0d43-2b90-4efd-890f-196a972c128b tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:39.068281 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0d0a0d43-2b90-4efd-890f-196a972c128b tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:39.201716 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-0d0a0d43-2b90-4efd-890f-196a972c128b tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:39.210104 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-0d0a0d43-2b90-4efd-890f-196a972c128b tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/635a0e04-c990-4a66-81ed-ab572007484b" status: 200 len: 1264 microversion: 2.1 time: 0.156225 Mar 31 18:22:39.210708 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 354/720] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:22:39 2022] GET /compute/v2.1/servers/635a0e04-c990-4a66-81ed-ab572007484b => generated 1264 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:22:39.923411 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-43c45b9a-f647-43fb-b497-0b7b2e3a7307 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:39.924043 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-43c45b9a-f647-43fb-b497-0b7b2e3a7307 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:39.930921 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-43c45b9a-f647-43fb-b497-0b7b2e3a7307 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:39.931371 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-43c45b9a-f647-43fb-b497-0b7b2e3a7307 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:39.932125 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-43c45b9a-f647-43fb-b497-0b7b2e3a7307 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:39.932550 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-43c45b9a-f647-43fb-b497-0b7b2e3a7307 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:40.071406 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-43c45b9a-f647-43fb-b497-0b7b2e3a7307 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:40.078584 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-43c45b9a-f647-43fb-b497-0b7b2e3a7307 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1574 microversion: 2.1 time: 0.158997 Mar 31 18:22:40.079160 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 367/721] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:22:39 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:22:40.227680 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-61cde446-1935-4326-9572-cba64b6c708a tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:40.228308 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-61cde446-1935-4326-9572-cba64b6c708a tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: 635a0e04-c990-4a66-81ed-ab572007484b] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:40.234211 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-61cde446-1935-4326-9572-cba64b6c708a tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:40.234676 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-61cde446-1935-4326-9572-cba64b6c708a tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:40.235417 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-61cde446-1935-4326-9572-cba64b6c708a tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:40.235838 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-61cde446-1935-4326-9572-cba64b6c708a tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:40.260531 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-97c575c1-852c-48a2-b746-9ff3aa868210 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:40.261020 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-97c575c1-852c-48a2-b746-9ff3aa868210 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:40.267201 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-97c575c1-852c-48a2-b746-9ff3aa868210 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:40.267652 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-97c575c1-852c-48a2-b746-9ff3aa868210 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:40.268412 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-97c575c1-852c-48a2-b746-9ff3aa868210 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:40.268846 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-97c575c1-852c-48a2-b746-9ff3aa868210 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:40.292804 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-97c575c1-852c-48a2-b746-9ff3aa868210 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f/ips" status: 200 len: 151 microversion: 2.20 time: 0.036083 Mar 31 18:22:40.293378 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 368/722] 10.222.0.58 () {60 vars in 1288 bytes} [Thu Mar 31 18:22:40 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f/ips => generated 151 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Mar 31 18:22:40.375339 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-61cde446-1935-4326-9572-cba64b6c708a tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:40.383778 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-61cde446-1935-4326-9572-cba64b6c708a tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/635a0e04-c990-4a66-81ed-ab572007484b" status: 200 len: 1264 microversion: 2.1 time: 0.159873 Mar 31 18:22:40.384465 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 355/723] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:22:40 2022] GET /compute/v2.1/servers/635a0e04-c990-4a66-81ed-ab572007484b => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:22:41.096563 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-9f08de5c-93a8-453a-b324-111331e56f10 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:41.097072 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-9f08de5c-93a8-453a-b324-111331e56f10 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:41.103918 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9f08de5c-93a8-453a-b324-111331e56f10 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:41.104389 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9f08de5c-93a8-453a-b324-111331e56f10 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:41.105146 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9f08de5c-93a8-453a-b324-111331e56f10 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:41.105594 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9f08de5c-93a8-453a-b324-111331e56f10 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:41.243984 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-9f08de5c-93a8-453a-b324-111331e56f10 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:41.251423 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-9f08de5c-93a8-453a-b324-111331e56f10 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1574 microversion: 2.1 time: 0.159139 Mar 31 18:22:41.251990 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 369/724] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:22:41 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1574 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:22:41.401036 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-3e9e024d-3e09-485c-814c-870277853fbf tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:41.401573 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-3e9e024d-3e09-485c-814c-870277853fbf tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: 635a0e04-c990-4a66-81ed-ab572007484b] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:41.407392 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3e9e024d-3e09-485c-814c-870277853fbf tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:41.407825 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3e9e024d-3e09-485c-814c-870277853fbf tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:41.408583 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3e9e024d-3e09-485c-814c-870277853fbf tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:41.408985 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3e9e024d-3e09-485c-814c-870277853fbf tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:41.541419 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-3e9e024d-3e09-485c-814c-870277853fbf tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:41.548847 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-3e9e024d-3e09-485c-814c-870277853fbf tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/635a0e04-c990-4a66-81ed-ab572007484b" status: 200 len: 1264 microversion: 2.1 time: 0.151713 Mar 31 18:22:41.552381 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 356/725] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:22:41 2022] GET /compute/v2.1/servers/635a0e04-c990-4a66-81ed-ab572007484b => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:22:42.268979 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-92d35bc1-6104-4ff9-afcd-f6ded751cfb1 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:42.269700 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-92d35bc1-6104-4ff9-afcd-f6ded751cfb1 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:42.275901 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-92d35bc1-6104-4ff9-afcd-f6ded751cfb1 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:42.276389 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-92d35bc1-6104-4ff9-afcd-f6ded751cfb1 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:42.277148 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-92d35bc1-6104-4ff9-afcd-f6ded751cfb1 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:42.277626 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-92d35bc1-6104-4ff9-afcd-f6ded751cfb1 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:42.412624 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-92d35bc1-6104-4ff9-afcd-f6ded751cfb1 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:42.419885 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-92d35bc1-6104-4ff9-afcd-f6ded751cfb1 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1574 microversion: 2.1 time: 0.154831 Mar 31 18:22:42.420449 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 370/726] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:22:42 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:22:42.567390 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-1bda0652-a6f7-41a3-ae0d-949dc5773f6a tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:42.567940 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-1bda0652-a6f7-41a3-ae0d-949dc5773f6a tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: 635a0e04-c990-4a66-81ed-ab572007484b] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:42.573852 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1bda0652-a6f7-41a3-ae0d-949dc5773f6a tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:42.574286 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1bda0652-a6f7-41a3-ae0d-949dc5773f6a tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:42.575088 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1bda0652-a6f7-41a3-ae0d-949dc5773f6a tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:42.575548 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1bda0652-a6f7-41a3-ae0d-949dc5773f6a tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:42.713627 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-1bda0652-a6f7-41a3-ae0d-949dc5773f6a tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:42.720717 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-1bda0652-a6f7-41a3-ae0d-949dc5773f6a tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/635a0e04-c990-4a66-81ed-ab572007484b" status: 200 len: 1264 microversion: 2.1 time: 0.158146 Mar 31 18:22:42.721283 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 357/727] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:22:42 2022] GET /compute/v2.1/servers/635a0e04-c990-4a66-81ed-ab572007484b => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:22:43.436663 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-e2832641-4e4c-45ab-b7ad-45b2093bb4a9 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:43.437184 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-e2832641-4e4c-45ab-b7ad-45b2093bb4a9 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:43.444141 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e2832641-4e4c-45ab-b7ad-45b2093bb4a9 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:43.444579 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e2832641-4e4c-45ab-b7ad-45b2093bb4a9 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:43.445332 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e2832641-4e4c-45ab-b7ad-45b2093bb4a9 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:43.445754 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e2832641-4e4c-45ab-b7ad-45b2093bb4a9 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:43.467520 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-edac7a85-b681-447f-b1ef-2203374a37dc tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:22:43.468039 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-edac7a85-b681-447f-b1ef-2203374a37dc tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:43.473889 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-edac7a85-b681-447f-b1ef-2203374a37dc tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:43.474325 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-edac7a85-b681-447f-b1ef-2203374a37dc tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:43.475104 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-edac7a85-b681-447f-b1ef-2203374a37dc tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:43.475532 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-edac7a85-b681-447f-b1ef-2203374a37dc tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:43.497258 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.objects.instance [None req-edac7a85-b681-447f-b1ef-2203374a37dc tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lazy-loading 'flavor' on Instance uuid e404c053-bc21-4cf0-9ba6-07e6971e588f {{(pid=117539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 31 18:22:43.587125 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-e2832641-4e4c-45ab-b7ad-45b2093bb4a9 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:43.595190 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-e2832641-4e4c-45ab-b7ad-45b2093bb4a9 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1574 microversion: 2.1 time: 0.162305 Mar 31 18:22:43.596108 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 371/728] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:22:43 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1574 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:22:43.738703 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-e2e1d83a-4b34-46ca-887f-dfd963c58779 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:43.739346 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-e2e1d83a-4b34-46ca-887f-dfd963c58779 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: 635a0e04-c990-4a66-81ed-ab572007484b] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:43.745879 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e2e1d83a-4b34-46ca-887f-dfd963c58779 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:43.746407 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e2e1d83a-4b34-46ca-887f-dfd963c58779 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:43.747228 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e2e1d83a-4b34-46ca-887f-dfd963c58779 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:43.747667 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e2e1d83a-4b34-46ca-887f-dfd963c58779 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:43.987046 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-e2e1d83a-4b34-46ca-887f-dfd963c58779 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:43.995108 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-e2e1d83a-4b34-46ca-887f-dfd963c58779 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/635a0e04-c990-4a66-81ed-ab572007484b" status: 200 len: 1264 microversion: 2.1 time: 0.261328 Mar 31 18:22:43.995625 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 372/729] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:22:43 2022] GET /compute/v2.1/servers/635a0e04-c990-4a66-81ed-ab572007484b => generated 1264 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:22:44.053407 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-edac7a85-b681-447f-b1ef-2203374a37dc tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "POST /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f/action" status: 202 len: 0 microversion: 2.20 time: 0.589288 Mar 31 18:22:44.054719 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 358/730] 10.222.0.58 () {62 vars in 1318 bytes} [Thu Mar 31 18:22:43 2022] POST /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f/action => generated 0 bytes in 592 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Mar 31 18:22:44.063051 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-75746943-c0c8-4d28-b388-818afbf612a4 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:44.064519 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-75746943-c0c8-4d28-b388-818afbf612a4 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:44.072199 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-75746943-c0c8-4d28-b388-818afbf612a4 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:44.072649 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-75746943-c0c8-4d28-b388-818afbf612a4 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:44.073604 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-75746943-c0c8-4d28-b388-818afbf612a4 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:44.074651 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-75746943-c0c8-4d28-b388-818afbf612a4 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:44.288369 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-75746943-c0c8-4d28-b388-818afbf612a4 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:44.296026 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-75746943-c0c8-4d28-b388-818afbf612a4 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:44.297525 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-75746943-c0c8-4d28-b388-818afbf612a4 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:44.298713 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-75746943-c0c8-4d28-b388-818afbf612a4 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1723 microversion: 2.20 time: 0.239755 Mar 31 18:22:44.299274 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 373/731] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:22:44 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1723 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:22:44.613374 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-5bdbcce2-6d40-4d17-b01a-77056e3472df tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:44.614086 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-5bdbcce2-6d40-4d17-b01a-77056e3472df tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:44.620457 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-5bdbcce2-6d40-4d17-b01a-77056e3472df tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:44.620889 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-5bdbcce2-6d40-4d17-b01a-77056e3472df tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:44.621636 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-5bdbcce2-6d40-4d17-b01a-77056e3472df tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:44.622143 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-5bdbcce2-6d40-4d17-b01a-77056e3472df tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:44.753620 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-5bdbcce2-6d40-4d17-b01a-77056e3472df tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:44.761713 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-5bdbcce2-6d40-4d17-b01a-77056e3472df tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1574 microversion: 2.1 time: 0.153165 Mar 31 18:22:44.762277 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 359/732] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:22:44 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1574 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:22:45.013077 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-e82e979f-4cfc-4a6e-b804-924257370b27 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:45.013696 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-e82e979f-4cfc-4a6e-b804-924257370b27 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: 635a0e04-c990-4a66-81ed-ab572007484b] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:45.019883 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e82e979f-4cfc-4a6e-b804-924257370b27 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:45.021070 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e82e979f-4cfc-4a6e-b804-924257370b27 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:45.022041 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e82e979f-4cfc-4a6e-b804-924257370b27 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:45.022481 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e82e979f-4cfc-4a6e-b804-924257370b27 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:45.056435 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [req-6dffdac6-655c-48e4-990a-e4279e6f37ef req-15a0dc0d-a6ed-4e61-92ef-b98f6035c0e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61abeff2-268a-4149-9962-497c409663ed", "name": "network-vif-plugged", "status": "completed", "tag": "156f9ff9-ec0d-4ac3-a7d7-2fa14dbead9a"}]} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:22:45.066783 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-6dffdac6-655c-48e4-990a-e4279e6f37ef req-15a0dc0d-a6ed-4e61-92ef-b98f6035c0e2 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:45.067948 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-6dffdac6-655c-48e4-990a-e4279e6f37ef req-15a0dc0d-a6ed-4e61-92ef-b98f6035c0e2 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:45.079725 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.compute.server_external_events [req-6dffdac6-655c-48e4-990a-e4279e6f37ef req-15a0dc0d-a6ed-4e61-92ef-b98f6035c0e2 service nova] Creating event network-vif-plugged:156f9ff9-ec0d-4ac3-a7d7-2fa14dbead9a for instance 61abeff2-268a-4149-9962-497c409663ed on hv-cinder-maste Mar 31 18:22:45.085398 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [req-6dffdac6-655c-48e4-990a-e4279e6f37ef req-15a0dc0d-a6ed-4e61-92ef-b98f6035c0e2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033569 Mar 31 18:22:45.086438 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 360/733] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:22:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 31 18:22:45.167939 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-e82e979f-4cfc-4a6e-b804-924257370b27 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:45.175511 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-e82e979f-4cfc-4a6e-b804-924257370b27 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/635a0e04-c990-4a66-81ed-ab572007484b" status: 200 len: 1264 microversion: 2.1 time: 0.166672 Mar 31 18:22:45.176095 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 374/734] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:22:45 2022] GET /compute/v2.1/servers/635a0e04-c990-4a66-81ed-ab572007484b => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:22:45.318568 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-0fe2ed48-ee89-4de6-97d5-8e564b45cef5 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:45.319407 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-0fe2ed48-ee89-4de6-97d5-8e564b45cef5 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:45.326023 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0fe2ed48-ee89-4de6-97d5-8e564b45cef5 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:45.326501 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0fe2ed48-ee89-4de6-97d5-8e564b45cef5 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:45.330150 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0fe2ed48-ee89-4de6-97d5-8e564b45cef5 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:45.330150 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0fe2ed48-ee89-4de6-97d5-8e564b45cef5 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:45.465309 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-0fe2ed48-ee89-4de6-97d5-8e564b45cef5 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:45.473153 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-0fe2ed48-ee89-4de6-97d5-8e564b45cef5 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:45.474689 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-0fe2ed48-ee89-4de6-97d5-8e564b45cef5 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:45.475858 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-0fe2ed48-ee89-4de6-97d5-8e564b45cef5 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1723 microversion: 2.20 time: 0.162210 Mar 31 18:22:45.476414 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 361/735] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:22:45 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:22:45.778857 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-f3b6b4f4-0a6a-49ae-8da2-cd39c240550f tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:45.779471 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-f3b6b4f4-0a6a-49ae-8da2-cd39c240550f tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:45.785349 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f3b6b4f4-0a6a-49ae-8da2-cd39c240550f tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:45.786302 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f3b6b4f4-0a6a-49ae-8da2-cd39c240550f tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:45.787097 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f3b6b4f4-0a6a-49ae-8da2-cd39c240550f tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:45.787535 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f3b6b4f4-0a6a-49ae-8da2-cd39c240550f tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:45.924422 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-f3b6b4f4-0a6a-49ae-8da2-cd39c240550f tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:45.932205 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-f3b6b4f4-0a6a-49ae-8da2-cd39c240550f tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1574 microversion: 2.1 time: 0.157280 Mar 31 18:22:45.932770 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 375/736] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:22:45 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:22:46.193091 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-530be7ed-f9b2-4524-ac89-fd5b3083b059 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:46.193713 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-530be7ed-f9b2-4524-ac89-fd5b3083b059 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: 635a0e04-c990-4a66-81ed-ab572007484b] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:46.199754 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-530be7ed-f9b2-4524-ac89-fd5b3083b059 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:46.200194 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-530be7ed-f9b2-4524-ac89-fd5b3083b059 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:46.200947 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-530be7ed-f9b2-4524-ac89-fd5b3083b059 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:46.201371 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-530be7ed-f9b2-4524-ac89-fd5b3083b059 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:46.335745 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-530be7ed-f9b2-4524-ac89-fd5b3083b059 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:46.342971 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-530be7ed-f9b2-4524-ac89-fd5b3083b059 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/635a0e04-c990-4a66-81ed-ab572007484b" status: 200 len: 1264 microversion: 2.1 time: 0.153815 Mar 31 18:22:46.343574 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 362/737] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:22:46 2022] GET /compute/v2.1/servers/635a0e04-c990-4a66-81ed-ab572007484b => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:22:46.493848 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-e5463003-599c-4a4a-8075-c85fb4fbcdbb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:46.494455 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-e5463003-599c-4a4a-8075-c85fb4fbcdbb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:46.500903 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e5463003-599c-4a4a-8075-c85fb4fbcdbb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:46.501348 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e5463003-599c-4a4a-8075-c85fb4fbcdbb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:46.502103 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e5463003-599c-4a4a-8075-c85fb4fbcdbb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:46.502534 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e5463003-599c-4a4a-8075-c85fb4fbcdbb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:46.635537 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-e5463003-599c-4a4a-8075-c85fb4fbcdbb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:46.643368 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-e5463003-599c-4a4a-8075-c85fb4fbcdbb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:46.644848 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-e5463003-599c-4a4a-8075-c85fb4fbcdbb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:46.646629 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-e5463003-599c-4a4a-8075-c85fb4fbcdbb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1723 microversion: 2.20 time: 0.157352 Mar 31 18:22:46.647184 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 376/738] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:22:46 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:22:46.948666 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-f6442396-4706-4d3c-883b-cc7158383240 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:46.949184 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-f6442396-4706-4d3c-883b-cc7158383240 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:46.955050 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-f6442396-4706-4d3c-883b-cc7158383240 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:46.955488 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-f6442396-4706-4d3c-883b-cc7158383240 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:46.956238 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-f6442396-4706-4d3c-883b-cc7158383240 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:46.956665 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-f6442396-4706-4d3c-883b-cc7158383240 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:47.089380 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-f6442396-4706-4d3c-883b-cc7158383240 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:47.096667 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-f6442396-4706-4d3c-883b-cc7158383240 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1574 microversion: 2.1 time: 0.151949 Mar 31 18:22:47.097223 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 363/739] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:22:46 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1574 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:22:47.359680 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-a1d2eef3-0e13-46c7-9220-8f3c4d8448f8 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:47.360325 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-a1d2eef3-0e13-46c7-9220-8f3c4d8448f8 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: 635a0e04-c990-4a66-81ed-ab572007484b] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:47.367444 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a1d2eef3-0e13-46c7-9220-8f3c4d8448f8 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:47.367884 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a1d2eef3-0e13-46c7-9220-8f3c4d8448f8 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:47.368653 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a1d2eef3-0e13-46c7-9220-8f3c4d8448f8 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:47.369086 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a1d2eef3-0e13-46c7-9220-8f3c4d8448f8 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:47.502065 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-a1d2eef3-0e13-46c7-9220-8f3c4d8448f8 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:47.509568 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-a1d2eef3-0e13-46c7-9220-8f3c4d8448f8 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/635a0e04-c990-4a66-81ed-ab572007484b" status: 200 len: 1264 microversion: 2.1 time: 0.153771 Mar 31 18:22:47.510132 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 377/740] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:22:47 2022] GET /compute/v2.1/servers/635a0e04-c990-4a66-81ed-ab572007484b => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:22:47.665763 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-fb2da303-850b-413c-8260-e1c5a5868014 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:47.666276 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-fb2da303-850b-413c-8260-e1c5a5868014 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:47.672311 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-fb2da303-850b-413c-8260-e1c5a5868014 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:47.672748 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-fb2da303-850b-413c-8260-e1c5a5868014 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:47.673544 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-fb2da303-850b-413c-8260-e1c5a5868014 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:47.673970 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-fb2da303-850b-413c-8260-e1c5a5868014 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:47.807976 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-fb2da303-850b-413c-8260-e1c5a5868014 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:47.815646 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-fb2da303-850b-413c-8260-e1c5a5868014 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:47.817853 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-fb2da303-850b-413c-8260-e1c5a5868014 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:47.819131 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-fb2da303-850b-413c-8260-e1c5a5868014 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1723 microversion: 2.20 time: 0.158010 Mar 31 18:22:47.819696 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 364/741] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:22:47 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:22:48.113256 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-b9ebe57a-075e-42b8-b775-a63285a8cf77 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:48.113855 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-b9ebe57a-075e-42b8-b775-a63285a8cf77 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:48.120324 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b9ebe57a-075e-42b8-b775-a63285a8cf77 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:48.120758 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b9ebe57a-075e-42b8-b775-a63285a8cf77 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:48.121543 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b9ebe57a-075e-42b8-b775-a63285a8cf77 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:48.121966 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b9ebe57a-075e-42b8-b775-a63285a8cf77 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:48.255670 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-b9ebe57a-075e-42b8-b775-a63285a8cf77 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:48.263445 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-b9ebe57a-075e-42b8-b775-a63285a8cf77 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1561 microversion: 2.1 time: 0.154066 Mar 31 18:22:48.263999 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 378/742] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:22:48 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1561 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:22:48.527343 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-48ed8d80-9602-41b7-9f87-a1adc12ac5d3 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:48.527943 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-48ed8d80-9602-41b7-9f87-a1adc12ac5d3 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: 635a0e04-c990-4a66-81ed-ab572007484b] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:48.533917 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-48ed8d80-9602-41b7-9f87-a1adc12ac5d3 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:48.534351 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-48ed8d80-9602-41b7-9f87-a1adc12ac5d3 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:48.535133 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-48ed8d80-9602-41b7-9f87-a1adc12ac5d3 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:48.535561 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-48ed8d80-9602-41b7-9f87-a1adc12ac5d3 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:48.668751 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-48ed8d80-9602-41b7-9f87-a1adc12ac5d3 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:48.675963 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-48ed8d80-9602-41b7-9f87-a1adc12ac5d3 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/635a0e04-c990-4a66-81ed-ab572007484b" status: 200 len: 1264 microversion: 2.1 time: 0.152399 Mar 31 18:22:48.676695 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 365/743] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:22:48 2022] GET /compute/v2.1/servers/635a0e04-c990-4a66-81ed-ab572007484b => generated 1264 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:22:48.837232 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-ce4b5b21-bf96-43a6-9e31-ad9fe45ae795 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:48.837747 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-ce4b5b21-bf96-43a6-9e31-ad9fe45ae795 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:48.843968 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-ce4b5b21-bf96-43a6-9e31-ad9fe45ae795 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:48.844403 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-ce4b5b21-bf96-43a6-9e31-ad9fe45ae795 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:48.845150 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-ce4b5b21-bf96-43a6-9e31-ad9fe45ae795 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:48.845575 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-ce4b5b21-bf96-43a6-9e31-ad9fe45ae795 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:48.978152 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-ce4b5b21-bf96-43a6-9e31-ad9fe45ae795 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:48.985813 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-ce4b5b21-bf96-43a6-9e31-ad9fe45ae795 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:48.987325 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-ce4b5b21-bf96-43a6-9e31-ad9fe45ae795 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:48.988475 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-ce4b5b21-bf96-43a6-9e31-ad9fe45ae795 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1723 microversion: 2.20 time: 0.156017 Mar 31 18:22:48.989027 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 379/744] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:22:48 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:22:49.693044 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-7621292b-b676-4091-990b-b5d312376584 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:49.694506 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-7621292b-b676-4091-990b-b5d312376584 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: 635a0e04-c990-4a66-81ed-ab572007484b] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:49.700369 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-7621292b-b676-4091-990b-b5d312376584 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:49.700801 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-7621292b-b676-4091-990b-b5d312376584 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:49.701576 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-7621292b-b676-4091-990b-b5d312376584 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:49.702002 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-7621292b-b676-4091-990b-b5d312376584 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:49.839655 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-7621292b-b676-4091-990b-b5d312376584 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:49.846893 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-7621292b-b676-4091-990b-b5d312376584 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/635a0e04-c990-4a66-81ed-ab572007484b" status: 200 len: 1264 microversion: 2.1 time: 0.157579 Mar 31 18:22:49.847450 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 366/745] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:22:49 2022] GET /compute/v2.1/servers/635a0e04-c990-4a66-81ed-ab572007484b => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:22:50.007497 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-27c62efa-265a-4058-825a-876f0b6ae127 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:50.008157 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-27c62efa-265a-4058-825a-876f0b6ae127 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:50.014999 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-27c62efa-265a-4058-825a-876f0b6ae127 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:50.015446 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-27c62efa-265a-4058-825a-876f0b6ae127 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:50.016238 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-27c62efa-265a-4058-825a-876f0b6ae127 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:50.016672 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-27c62efa-265a-4058-825a-876f0b6ae127 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:50.152206 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-27c62efa-265a-4058-825a-876f0b6ae127 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:50.159943 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-27c62efa-265a-4058-825a-876f0b6ae127 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:50.161444 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-27c62efa-265a-4058-825a-876f0b6ae127 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:50.163401 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-27c62efa-265a-4058-825a-876f0b6ae127 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1723 microversion: 2.20 time: 0.159651 Mar 31 18:22:50.163858 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 380/746] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:22:50 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:22:50.865448 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-c0db65ee-634c-4055-85ff-1b970807472e tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:50.865990 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-c0db65ee-634c-4055-85ff-1b970807472e tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: 635a0e04-c990-4a66-81ed-ab572007484b] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:50.872509 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c0db65ee-634c-4055-85ff-1b970807472e tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:50.872949 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c0db65ee-634c-4055-85ff-1b970807472e tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:50.873697 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c0db65ee-634c-4055-85ff-1b970807472e tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:50.874125 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c0db65ee-634c-4055-85ff-1b970807472e tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:51.007008 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-c0db65ee-634c-4055-85ff-1b970807472e tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:51.014870 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-c0db65ee-634c-4055-85ff-1b970807472e tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/635a0e04-c990-4a66-81ed-ab572007484b" status: 200 len: 1264 microversion: 2.1 time: 0.153359 Mar 31 18:22:51.015465 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 367/747] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:22:50 2022] GET /compute/v2.1/servers/635a0e04-c990-4a66-81ed-ab572007484b => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:22:51.154433 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [req-29e4943b-8a8b-4d6a-886b-ad93f699c288 req-515e62f0-65ff-4ff6-a7e4-658873261ec5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "635a0e04-c990-4a66-81ed-ab572007484b", "name": "network-vif-plugged", "status": "completed", "tag": "8009d02e-5d59-48da-9d8c-071ba781cd76"}]} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:22:51.163080 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-29e4943b-8a8b-4d6a-886b-ad93f699c288 req-515e62f0-65ff-4ff6-a7e4-658873261ec5 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:51.163520 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-29e4943b-8a8b-4d6a-886b-ad93f699c288 req-515e62f0-65ff-4ff6-a7e4-658873261ec5 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:51.174824 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.compute.server_external_events [req-29e4943b-8a8b-4d6a-886b-ad93f699c288 req-515e62f0-65ff-4ff6-a7e4-658873261ec5 service nova] Creating event network-vif-plugged:8009d02e-5d59-48da-9d8c-071ba781cd76 for instance 635a0e04-c990-4a66-81ed-ab572007484b on hv-cinder-maste Mar 31 18:22:51.179956 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [req-29e4943b-8a8b-4d6a-886b-ad93f699c288 req-515e62f0-65ff-4ff6-a7e4-658873261ec5 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029180 Mar 31 18:22:51.180583 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 381/748] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:22:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:22:51.182722 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-f820eba2-1f9e-4fa1-be92-3bd16b779a45 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:51.183403 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-f820eba2-1f9e-4fa1-be92-3bd16b779a45 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:51.189246 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-f820eba2-1f9e-4fa1-be92-3bd16b779a45 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:51.189694 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-f820eba2-1f9e-4fa1-be92-3bd16b779a45 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:51.190479 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-f820eba2-1f9e-4fa1-be92-3bd16b779a45 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:51.190928 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-f820eba2-1f9e-4fa1-be92-3bd16b779a45 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:51.326413 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-f820eba2-1f9e-4fa1-be92-3bd16b779a45 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:51.334351 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-f820eba2-1f9e-4fa1-be92-3bd16b779a45 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:51.336531 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-f820eba2-1f9e-4fa1-be92-3bd16b779a45 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:51.337781 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-f820eba2-1f9e-4fa1-be92-3bd16b779a45 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1723 microversion: 2.20 time: 0.160511 Mar 31 18:22:51.338334 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 368/749] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:22:51 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 31 18:22:52.032308 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-fb87c5cf-e46e-4003-bb63-c7b6769fe1aa tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:52.033032 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-fb87c5cf-e46e-4003-bb63-c7b6769fe1aa tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: 635a0e04-c990-4a66-81ed-ab572007484b] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:52.039845 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-fb87c5cf-e46e-4003-bb63-c7b6769fe1aa tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:52.040288 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-fb87c5cf-e46e-4003-bb63-c7b6769fe1aa tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:52.041045 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-fb87c5cf-e46e-4003-bb63-c7b6769fe1aa tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:52.041529 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-fb87c5cf-e46e-4003-bb63-c7b6769fe1aa tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:52.181289 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-fb87c5cf-e46e-4003-bb63-c7b6769fe1aa tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:52.188574 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-fb87c5cf-e46e-4003-bb63-c7b6769fe1aa tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/635a0e04-c990-4a66-81ed-ab572007484b" status: 200 len: 1264 microversion: 2.1 time: 0.160423 Mar 31 18:22:52.189158 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 382/750] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:22:52 2022] GET /compute/v2.1/servers/635a0e04-c990-4a66-81ed-ab572007484b => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:22:52.356072 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-e5a328af-fef9-42ed-9261-b75a6276ed1e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:52.356672 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-e5a328af-fef9-42ed-9261-b75a6276ed1e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:52.362592 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e5a328af-fef9-42ed-9261-b75a6276ed1e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:52.363055 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e5a328af-fef9-42ed-9261-b75a6276ed1e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:52.363792 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e5a328af-fef9-42ed-9261-b75a6276ed1e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:52.364211 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e5a328af-fef9-42ed-9261-b75a6276ed1e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:52.499128 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-e5a328af-fef9-42ed-9261-b75a6276ed1e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:52.506761 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-e5a328af-fef9-42ed-9261-b75a6276ed1e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:52.508792 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-e5a328af-fef9-42ed-9261-b75a6276ed1e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:52.509923 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-e5a328af-fef9-42ed-9261-b75a6276ed1e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1723 microversion: 2.20 time: 0.158128 Mar 31 18:22:52.510474 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 369/751] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:22:52 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:22:53.205463 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-3f049f99-6ba6-4eaa-8091-9226d115c6cb tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:53.206124 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-3f049f99-6ba6-4eaa-8091-9226d115c6cb tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: 635a0e04-c990-4a66-81ed-ab572007484b] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:53.212654 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3f049f99-6ba6-4eaa-8091-9226d115c6cb tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:53.213092 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3f049f99-6ba6-4eaa-8091-9226d115c6cb tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:53.213842 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3f049f99-6ba6-4eaa-8091-9226d115c6cb tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:53.214270 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3f049f99-6ba6-4eaa-8091-9226d115c6cb tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:53.349193 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-3f049f99-6ba6-4eaa-8091-9226d115c6cb tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:53.357061 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-3f049f99-6ba6-4eaa-8091-9226d115c6cb tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/635a0e04-c990-4a66-81ed-ab572007484b" status: 200 len: 1264 microversion: 2.1 time: 0.155562 Mar 31 18:22:53.357632 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 383/752] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:22:53 2022] GET /compute/v2.1/servers/635a0e04-c990-4a66-81ed-ab572007484b => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:22:53.529037 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-e544a162-1f56-45b2-88f0-f6642e25550a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:53.529687 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-e544a162-1f56-45b2-88f0-f6642e25550a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:53.535560 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e544a162-1f56-45b2-88f0-f6642e25550a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:53.536001 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e544a162-1f56-45b2-88f0-f6642e25550a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:53.536749 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e544a162-1f56-45b2-88f0-f6642e25550a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:53.537172 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e544a162-1f56-45b2-88f0-f6642e25550a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:53.718002 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-e544a162-1f56-45b2-88f0-f6642e25550a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:53.718002 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-e544a162-1f56-45b2-88f0-f6642e25550a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:53.718287 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-e544a162-1f56-45b2-88f0-f6642e25550a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:53.718287 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-e544a162-1f56-45b2-88f0-f6642e25550a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1723 microversion: 2.20 time: 0.156522 Mar 31 18:22:53.718287 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 370/753] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:22:53 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:22:54.373949 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-f9e43fc3-a363-4a8b-9d04-1a64347790db tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:54.374506 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-f9e43fc3-a363-4a8b-9d04-1a64347790db tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: 635a0e04-c990-4a66-81ed-ab572007484b] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:54.380635 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f9e43fc3-a363-4a8b-9d04-1a64347790db tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:54.381073 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f9e43fc3-a363-4a8b-9d04-1a64347790db tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:54.381819 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f9e43fc3-a363-4a8b-9d04-1a64347790db tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:54.382246 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f9e43fc3-a363-4a8b-9d04-1a64347790db tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:54.519216 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-f9e43fc3-a363-4a8b-9d04-1a64347790db tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:54.526594 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-f9e43fc3-a363-4a8b-9d04-1a64347790db tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/635a0e04-c990-4a66-81ed-ab572007484b" status: 200 len: 1450 microversion: 2.1 time: 0.156589 Mar 31 18:22:54.527171 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 384/754] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:22:54 2022] GET /compute/v2.1/servers/635a0e04-c990-4a66-81ed-ab572007484b => generated 1450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:22:54.542786 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-f75093a9-e685-4f21-8bc7-5078d78a572a tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:54.543388 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-f75093a9-e685-4f21-8bc7-5078d78a572a tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: 635a0e04-c990-4a66-81ed-ab572007484b] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:54.549316 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-f75093a9-e685-4f21-8bc7-5078d78a572a tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:54.549752 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-f75093a9-e685-4f21-8bc7-5078d78a572a tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:54.550498 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-f75093a9-e685-4f21-8bc7-5078d78a572a tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:54.550972 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-f75093a9-e685-4f21-8bc7-5078d78a572a tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:54.688322 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-f75093a9-e685-4f21-8bc7-5078d78a572a tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:54.695712 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-f75093a9-e685-4f21-8bc7-5078d78a572a tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/635a0e04-c990-4a66-81ed-ab572007484b" status: 200 len: 1450 microversion: 2.1 time: 0.157203 Mar 31 18:22:54.696314 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 371/755] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:22:54 2022] GET /compute/v2.1/servers/635a0e04-c990-4a66-81ed-ab572007484b => generated 1450 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:22:54.700129 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-9afdb4a9-f44c-4085-96bd-fbca632d4f1d tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:54.700744 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-9afdb4a9-f44c-4085-96bd-fbca632d4f1d tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:54.706475 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9afdb4a9-f44c-4085-96bd-fbca632d4f1d tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:54.706954 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9afdb4a9-f44c-4085-96bd-fbca632d4f1d tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:54.707737 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9afdb4a9-f44c-4085-96bd-fbca632d4f1d tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:54.708163 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9afdb4a9-f44c-4085-96bd-fbca632d4f1d tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:55.032161 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-9afdb4a9-f44c-4085-96bd-fbca632d4f1d tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:55.040549 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-9afdb4a9-f44c-4085-96bd-fbca632d4f1d tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:55.042035 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-9afdb4a9-f44c-4085-96bd-fbca632d4f1d tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:55.043235 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-9afdb4a9-f44c-4085-96bd-fbca632d4f1d tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1723 microversion: 2.20 time: 0.346970 Mar 31 18:22:55.043790 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 385/756] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:22:54 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1723 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 31 18:22:56.064588 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-129ff9a8-65b3-407c-8b1b-c300a44ae386 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:56.070182 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-129ff9a8-65b3-407c-8b1b-c300a44ae386 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:56.071456 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-129ff9a8-65b3-407c-8b1b-c300a44ae386 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:56.071901 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-129ff9a8-65b3-407c-8b1b-c300a44ae386 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:56.072669 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-129ff9a8-65b3-407c-8b1b-c300a44ae386 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:56.073104 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-129ff9a8-65b3-407c-8b1b-c300a44ae386 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:56.205961 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-129ff9a8-65b3-407c-8b1b-c300a44ae386 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:56.213832 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-129ff9a8-65b3-407c-8b1b-c300a44ae386 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:56.215366 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-129ff9a8-65b3-407c-8b1b-c300a44ae386 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:56.216676 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-129ff9a8-65b3-407c-8b1b-c300a44ae386 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1744 microversion: 2.20 time: 0.156107 Mar 31 18:22:56.217242 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 372/757] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:22:56 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:22:57.106664 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [req-085193ef-acc7-4313-9479-09a2a6be55de req-f521a6fb-3f1f-437a-aedf-de43b1e01894 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "635a0e04-c990-4a66-81ed-ab572007484b", "tag": "8009d02e-5d59-48da-9d8c-071ba781cd76"}]} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:22:57.112519 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-085193ef-acc7-4313-9479-09a2a6be55de req-f521a6fb-3f1f-437a-aedf-de43b1e01894 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:57.113038 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-085193ef-acc7-4313-9479-09a2a6be55de req-f521a6fb-3f1f-437a-aedf-de43b1e01894 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:57.124567 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.compute.server_external_events [req-085193ef-acc7-4313-9479-09a2a6be55de req-f521a6fb-3f1f-437a-aedf-de43b1e01894 service nova] Creating event network-changed:8009d02e-5d59-48da-9d8c-071ba781cd76 for instance 635a0e04-c990-4a66-81ed-ab572007484b on hv-cinder-maste Mar 31 18:22:57.129565 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [req-085193ef-acc7-4313-9479-09a2a6be55de req-f521a6fb-3f1f-437a-aedf-de43b1e01894 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030699 Mar 31 18:22:57.133257 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 386/758] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:22:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 31 18:22:57.236207 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-358d92a4-a276-45e3-abe2-fd85b25a4406 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:57.238073 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-358d92a4-a276-45e3-abe2-fd85b25a4406 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:57.242864 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-358d92a4-a276-45e3-abe2-fd85b25a4406 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:57.243314 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-358d92a4-a276-45e3-abe2-fd85b25a4406 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:57.244224 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-358d92a4-a276-45e3-abe2-fd85b25a4406 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:57.244669 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-358d92a4-a276-45e3-abe2-fd85b25a4406 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:57.416335 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-358d92a4-a276-45e3-abe2-fd85b25a4406 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:57.425076 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-358d92a4-a276-45e3-abe2-fd85b25a4406 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:57.426738 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-358d92a4-a276-45e3-abe2-fd85b25a4406 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:57.427879 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-358d92a4-a276-45e3-abe2-fd85b25a4406 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1744 microversion: 2.20 time: 0.195740 Mar 31 18:22:57.428647 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 373/759] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:22:57 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1744 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:22:58.448444 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-3335825a-34e6-427d-8b26-4889fb14154d tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:58.449130 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-3335825a-34e6-427d-8b26-4889fb14154d tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:58.455167 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3335825a-34e6-427d-8b26-4889fb14154d tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:58.455614 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3335825a-34e6-427d-8b26-4889fb14154d tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:58.456389 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3335825a-34e6-427d-8b26-4889fb14154d tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:58.456812 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3335825a-34e6-427d-8b26-4889fb14154d tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:58.593621 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-3335825a-34e6-427d-8b26-4889fb14154d tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:58.601593 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-3335825a-34e6-427d-8b26-4889fb14154d tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:58.603115 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-3335825a-34e6-427d-8b26-4889fb14154d tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:58.604253 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-3335825a-34e6-427d-8b26-4889fb14154d tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1744 microversion: 2.20 time: 0.161165 Mar 31 18:22:58.604824 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 387/760] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:22:58 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1744 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:22:59.134479 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [req-7e6ad9b6-2901-42ac-ad9d-4ce6179a1c59 req-78a1ac55-603f-4839-b622-d4cb6c683164 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e404c053-bc21-4cf0-9ba6-07e6971e588f", "name": "network-vif-plugged", "status": "completed", "tag": "af48c6cc-61d7-40f4-85b0-60adf2267642"}]} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:22:59.142554 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-7e6ad9b6-2901-42ac-ad9d-4ce6179a1c59 req-78a1ac55-603f-4839-b622-d4cb6c683164 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:59.143025 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-7e6ad9b6-2901-42ac-ad9d-4ce6179a1c59 req-78a1ac55-603f-4839-b622-d4cb6c683164 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:59.154089 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.compute.server_external_events [req-7e6ad9b6-2901-42ac-ad9d-4ce6179a1c59 req-78a1ac55-603f-4839-b622-d4cb6c683164 service nova] Creating event network-vif-plugged:af48c6cc-61d7-40f4-85b0-60adf2267642 for instance e404c053-bc21-4cf0-9ba6-07e6971e588f on hv-cinder-maste Mar 31 18:22:59.159107 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [req-7e6ad9b6-2901-42ac-ad9d-4ce6179a1c59 req-78a1ac55-603f-4839-b622-d4cb6c683164 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028497 Mar 31 18:22:59.163233 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 374/761] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:22:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:22:59.623017 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-9c30c308-5a4f-49c0-8e40-d97b6f6744de tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:22:59.623622 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-9c30c308-5a4f-49c0-8e40-d97b6f6744de tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:22:59.629876 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9c30c308-5a4f-49c0-8e40-d97b6f6744de tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:59.630318 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9c30c308-5a4f-49c0-8e40-d97b6f6744de tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:59.631100 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9c30c308-5a4f-49c0-8e40-d97b6f6744de tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:22:59.631528 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9c30c308-5a4f-49c0-8e40-d97b6f6744de tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:22:59.762274 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-9c30c308-5a4f-49c0-8e40-d97b6f6744de tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:59.769860 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-9c30c308-5a4f-49c0-8e40-d97b6f6744de tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:59.771400 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-9c30c308-5a4f-49c0-8e40-d97b6f6744de tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:22:59.772541 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-9c30c308-5a4f-49c0-8e40-d97b6f6744de tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1744 microversion: 2.20 time: 0.153466 Mar 31 18:22:59.773381 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 388/762] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:22:59 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1744 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:23:00.792729 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-fbf6e71a-2311-4707-81e9-dfc8115dff76 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:23:00.793347 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-fbf6e71a-2311-4707-81e9-dfc8115dff76 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:23:00.799441 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-fbf6e71a-2311-4707-81e9-dfc8115dff76 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:00.799885 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-fbf6e71a-2311-4707-81e9-dfc8115dff76 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:00.800637 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-fbf6e71a-2311-4707-81e9-dfc8115dff76 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:00.801093 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-fbf6e71a-2311-4707-81e9-dfc8115dff76 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:00.932719 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-fbf6e71a-2311-4707-81e9-dfc8115dff76 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:00.940416 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-fbf6e71a-2311-4707-81e9-dfc8115dff76 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:00.941906 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-fbf6e71a-2311-4707-81e9-dfc8115dff76 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:00.943079 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-fbf6e71a-2311-4707-81e9-dfc8115dff76 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1744 microversion: 2.20 time: 0.154814 Mar 31 18:23:00.943650 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 375/763] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:23:00 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1744 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:23:01.961487 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-80fd6043-4a61-423d-8f47-a23dfa62d7b8 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:23:01.962223 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-80fd6043-4a61-423d-8f47-a23dfa62d7b8 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:23:01.968420 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-80fd6043-4a61-423d-8f47-a23dfa62d7b8 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:01.968867 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-80fd6043-4a61-423d-8f47-a23dfa62d7b8 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:01.969629 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-80fd6043-4a61-423d-8f47-a23dfa62d7b8 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:01.970056 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-80fd6043-4a61-423d-8f47-a23dfa62d7b8 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:02.102469 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-80fd6043-4a61-423d-8f47-a23dfa62d7b8 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:02.110432 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-80fd6043-4a61-423d-8f47-a23dfa62d7b8 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:02.111932 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-80fd6043-4a61-423d-8f47-a23dfa62d7b8 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:02.113075 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-80fd6043-4a61-423d-8f47-a23dfa62d7b8 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1744 microversion: 2.20 time: 0.155632 Mar 31 18:23:02.113615 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 389/764] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:23:01 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1744 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 31 18:23:03.135047 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-585f5e56-0b5f-4e62-8d50-71e80809529e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:23:03.135907 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-585f5e56-0b5f-4e62-8d50-71e80809529e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:23:03.143577 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-585f5e56-0b5f-4e62-8d50-71e80809529e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:03.144112 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-585f5e56-0b5f-4e62-8d50-71e80809529e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:03.144891 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-585f5e56-0b5f-4e62-8d50-71e80809529e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:03.145323 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-585f5e56-0b5f-4e62-8d50-71e80809529e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:03.304799 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-585f5e56-0b5f-4e62-8d50-71e80809529e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:03.316567 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-585f5e56-0b5f-4e62-8d50-71e80809529e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:03.318089 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-585f5e56-0b5f-4e62-8d50-71e80809529e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:03.319352 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-585f5e56-0b5f-4e62-8d50-71e80809529e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1739 microversion: 2.20 time: 0.191229 Mar 31 18:23:03.320131 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 376/765] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:23:03 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1739 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:23:04.338738 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-6c228b6c-1309-4a7e-b3ba-4b34cfe6a69c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:23:04.339342 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-6c228b6c-1309-4a7e-b3ba-4b34cfe6a69c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:23:04.345711 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6c228b6c-1309-4a7e-b3ba-4b34cfe6a69c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:04.346150 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6c228b6c-1309-4a7e-b3ba-4b34cfe6a69c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:04.346923 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6c228b6c-1309-4a7e-b3ba-4b34cfe6a69c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:04.347350 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6c228b6c-1309-4a7e-b3ba-4b34cfe6a69c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:04.500461 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-6c228b6c-1309-4a7e-b3ba-4b34cfe6a69c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:04.509814 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-6c228b6c-1309-4a7e-b3ba-4b34cfe6a69c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:04.512030 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-6c228b6c-1309-4a7e-b3ba-4b34cfe6a69c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:04.514167 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-6c228b6c-1309-4a7e-b3ba-4b34cfe6a69c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1739 microversion: 2.20 time: 0.178582 Mar 31 18:23:04.517018 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 390/766] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:23:04 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:23:05.534709 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-46fdfdfe-f8f0-4309-aa19-65dc36bfa90d tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:23:05.535933 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-46fdfdfe-f8f0-4309-aa19-65dc36bfa90d tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:23:05.543225 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-46fdfdfe-f8f0-4309-aa19-65dc36bfa90d tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:05.550335 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-46fdfdfe-f8f0-4309-aa19-65dc36bfa90d tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:05.550335 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-46fdfdfe-f8f0-4309-aa19-65dc36bfa90d tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:05.550335 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-46fdfdfe-f8f0-4309-aa19-65dc36bfa90d tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:05.712722 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-46fdfdfe-f8f0-4309-aa19-65dc36bfa90d tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:05.721808 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-46fdfdfe-f8f0-4309-aa19-65dc36bfa90d tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:05.723329 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-46fdfdfe-f8f0-4309-aa19-65dc36bfa90d tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:05.724738 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-46fdfdfe-f8f0-4309-aa19-65dc36bfa90d tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1739 microversion: 2.20 time: 0.193891 Mar 31 18:23:05.725289 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 377/767] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:23:05 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1739 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:23:06.746717 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-1d11d53b-acc4-49a5-aa5f-668997abe0fa tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:23:06.747327 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-1d11d53b-acc4-49a5-aa5f-668997abe0fa tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:23:06.754421 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-1d11d53b-acc4-49a5-aa5f-668997abe0fa tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:06.755250 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-1d11d53b-acc4-49a5-aa5f-668997abe0fa tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:06.756083 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-1d11d53b-acc4-49a5-aa5f-668997abe0fa tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:06.756594 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-1d11d53b-acc4-49a5-aa5f-668997abe0fa tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:06.906635 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-1d11d53b-acc4-49a5-aa5f-668997abe0fa tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:06.916135 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-1d11d53b-acc4-49a5-aa5f-668997abe0fa tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:06.917885 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-1d11d53b-acc4-49a5-aa5f-668997abe0fa tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:06.921339 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-1d11d53b-acc4-49a5-aa5f-668997abe0fa tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1739 microversion: 2.20 time: 0.179297 Mar 31 18:23:06.921339 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 391/768] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:23:06 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1739 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:23:07.940397 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-cffc1fc2-a140-4d80-8462-a64253efbfd6 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:23:07.941975 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-cffc1fc2-a140-4d80-8462-a64253efbfd6 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:23:07.949154 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-cffc1fc2-a140-4d80-8462-a64253efbfd6 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:07.952350 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-cffc1fc2-a140-4d80-8462-a64253efbfd6 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:07.952350 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-cffc1fc2-a140-4d80-8462-a64253efbfd6 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:07.952350 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-cffc1fc2-a140-4d80-8462-a64253efbfd6 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:08.116500 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-cffc1fc2-a140-4d80-8462-a64253efbfd6 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:08.125917 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-cffc1fc2-a140-4d80-8462-a64253efbfd6 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:08.127996 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-cffc1fc2-a140-4d80-8462-a64253efbfd6 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:08.133405 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-cffc1fc2-a140-4d80-8462-a64253efbfd6 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1739 microversion: 2.20 time: 0.192905 Mar 31 18:23:08.133405 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 378/769] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:23:07 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1739 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:23:09.149673 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-5b64db7d-09b9-448f-a8d9-21741a24b13e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:23:09.150944 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-5b64db7d-09b9-448f-a8d9-21741a24b13e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:23:09.158152 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-5b64db7d-09b9-448f-a8d9-21741a24b13e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:09.158540 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-5b64db7d-09b9-448f-a8d9-21741a24b13e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:09.159403 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-5b64db7d-09b9-448f-a8d9-21741a24b13e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:09.159863 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-5b64db7d-09b9-448f-a8d9-21741a24b13e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:09.307682 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-5b64db7d-09b9-448f-a8d9-21741a24b13e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:09.316198 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-5b64db7d-09b9-448f-a8d9-21741a24b13e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:09.317609 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-5b64db7d-09b9-448f-a8d9-21741a24b13e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:09.318804 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-5b64db7d-09b9-448f-a8d9-21741a24b13e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1739 microversion: 2.20 time: 0.174068 Mar 31 18:23:09.319356 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 392/770] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:23:09 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1739 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:23:10.339792 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-5458c9fc-8ae2-4048-a992-889d4714a224 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:23:10.340332 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-5458c9fc-8ae2-4048-a992-889d4714a224 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:23:10.348390 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-5458c9fc-8ae2-4048-a992-889d4714a224 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:10.348999 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-5458c9fc-8ae2-4048-a992-889d4714a224 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:10.350219 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-5458c9fc-8ae2-4048-a992-889d4714a224 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:10.351144 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-5458c9fc-8ae2-4048-a992-889d4714a224 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:10.520966 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-5458c9fc-8ae2-4048-a992-889d4714a224 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:10.530638 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-5458c9fc-8ae2-4048-a992-889d4714a224 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:10.532247 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-5458c9fc-8ae2-4048-a992-889d4714a224 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:10.533403 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-5458c9fc-8ae2-4048-a992-889d4714a224 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1739 microversion: 2.20 time: 0.198804 Mar 31 18:23:10.533952 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 379/771] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:23:10 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1739 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:23:11.552884 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-15092622-a3f5-4924-b9bd-ccdac843baaa tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:23:11.553500 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-15092622-a3f5-4924-b9bd-ccdac843baaa tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:23:11.562916 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-15092622-a3f5-4924-b9bd-ccdac843baaa tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:11.563619 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-15092622-a3f5-4924-b9bd-ccdac843baaa tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:11.565076 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-15092622-a3f5-4924-b9bd-ccdac843baaa tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:11.565822 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-15092622-a3f5-4924-b9bd-ccdac843baaa tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:11.721880 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-15092622-a3f5-4924-b9bd-ccdac843baaa tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:11.733075 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-15092622-a3f5-4924-b9bd-ccdac843baaa tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:11.733658 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-15092622-a3f5-4924-b9bd-ccdac843baaa tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:11.735616 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-15092622-a3f5-4924-b9bd-ccdac843baaa tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1739 microversion: 2.20 time: 0.186808 Mar 31 18:23:11.737860 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 393/772] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:23:11 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1739 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:23:12.755942 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-c44c9f69-8d87-41c4-b337-f63077d123b7 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:23:12.756532 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-c44c9f69-8d87-41c4-b337-f63077d123b7 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:23:12.763227 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c44c9f69-8d87-41c4-b337-f63077d123b7 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:12.767472 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c44c9f69-8d87-41c4-b337-f63077d123b7 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:12.767472 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c44c9f69-8d87-41c4-b337-f63077d123b7 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:12.767472 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c44c9f69-8d87-41c4-b337-f63077d123b7 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:12.900323 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-c44c9f69-8d87-41c4-b337-f63077d123b7 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:12.908656 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-c44c9f69-8d87-41c4-b337-f63077d123b7 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:12.910237 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-c44c9f69-8d87-41c4-b337-f63077d123b7 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:12.911540 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-c44c9f69-8d87-41c4-b337-f63077d123b7 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1739 microversion: 2.20 time: 0.160235 Mar 31 18:23:12.912088 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 380/773] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:23:12 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1739 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:23:13.932080 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-c94a07cc-fd41-4e56-86e2-45a861f9587b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:23:13.932690 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-c94a07cc-fd41-4e56-86e2-45a861f9587b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:23:13.939767 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c94a07cc-fd41-4e56-86e2-45a861f9587b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:13.940295 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c94a07cc-fd41-4e56-86e2-45a861f9587b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:13.941135 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c94a07cc-fd41-4e56-86e2-45a861f9587b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:13.941628 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c94a07cc-fd41-4e56-86e2-45a861f9587b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:14.093313 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-c94a07cc-fd41-4e56-86e2-45a861f9587b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:14.101112 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-c94a07cc-fd41-4e56-86e2-45a861f9587b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:14.107292 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-c94a07cc-fd41-4e56-86e2-45a861f9587b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:14.107292 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-c94a07cc-fd41-4e56-86e2-45a861f9587b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1739 microversion: 2.20 time: 0.177214 Mar 31 18:23:14.107292 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 394/774] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:23:13 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1739 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:23:15.123408 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-9ad6b56f-8b44-4f33-9c6e-183cea1a9011 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:23:15.124047 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-9ad6b56f-8b44-4f33-9c6e-183cea1a9011 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:23:15.129832 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9ad6b56f-8b44-4f33-9c6e-183cea1a9011 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:15.130262 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9ad6b56f-8b44-4f33-9c6e-183cea1a9011 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:15.131038 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9ad6b56f-8b44-4f33-9c6e-183cea1a9011 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:15.131458 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9ad6b56f-8b44-4f33-9c6e-183cea1a9011 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:15.265095 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-9ad6b56f-8b44-4f33-9c6e-183cea1a9011 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:15.273749 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-9ad6b56f-8b44-4f33-9c6e-183cea1a9011 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:15.275283 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-9ad6b56f-8b44-4f33-9c6e-183cea1a9011 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:15.276455 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-9ad6b56f-8b44-4f33-9c6e-183cea1a9011 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1739 microversion: 2.20 time: 0.157149 Mar 31 18:23:15.277010 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 381/775] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:23:15 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1739 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:23:16.294862 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-7ed15f8f-e7ef-42b4-9cf4-29da79bed82b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:23:16.295556 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-7ed15f8f-e7ef-42b4-9cf4-29da79bed82b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:23:16.301327 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-7ed15f8f-e7ef-42b4-9cf4-29da79bed82b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:16.301763 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-7ed15f8f-e7ef-42b4-9cf4-29da79bed82b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:16.302510 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-7ed15f8f-e7ef-42b4-9cf4-29da79bed82b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:16.302961 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-7ed15f8f-e7ef-42b4-9cf4-29da79bed82b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:16.439562 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-7ed15f8f-e7ef-42b4-9cf4-29da79bed82b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:16.447930 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-7ed15f8f-e7ef-42b4-9cf4-29da79bed82b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:16.449427 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-7ed15f8f-e7ef-42b4-9cf4-29da79bed82b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:16.450569 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-7ed15f8f-e7ef-42b4-9cf4-29da79bed82b tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1721 microversion: 2.20 time: 0.159645 Mar 31 18:23:16.451155 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 395/776] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:23:16 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:23:17.469279 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-713da4d4-0edc-4c42-a6bd-88e3c196d12a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:23:17.469899 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-713da4d4-0edc-4c42-a6bd-88e3c196d12a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:23:17.475975 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-713da4d4-0edc-4c42-a6bd-88e3c196d12a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:17.476412 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-713da4d4-0edc-4c42-a6bd-88e3c196d12a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:17.477846 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-713da4d4-0edc-4c42-a6bd-88e3c196d12a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:17.478272 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-713da4d4-0edc-4c42-a6bd-88e3c196d12a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:17.612194 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-713da4d4-0edc-4c42-a6bd-88e3c196d12a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:17.620159 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-713da4d4-0edc-4c42-a6bd-88e3c196d12a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:17.621644 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-713da4d4-0edc-4c42-a6bd-88e3c196d12a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:17.622817 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-713da4d4-0edc-4c42-a6bd-88e3c196d12a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1721 microversion: 2.20 time: 0.157467 Mar 31 18:23:17.623371 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 382/777] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:23:17 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:23:18.641592 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-1ebd373d-f332-46fa-bbe7-26d7920d041c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:23:18.642189 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-1ebd373d-f332-46fa-bbe7-26d7920d041c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:23:18.648481 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-1ebd373d-f332-46fa-bbe7-26d7920d041c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:18.649114 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-1ebd373d-f332-46fa-bbe7-26d7920d041c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:18.649871 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-1ebd373d-f332-46fa-bbe7-26d7920d041c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:18.650299 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-1ebd373d-f332-46fa-bbe7-26d7920d041c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:18.783047 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-1ebd373d-f332-46fa-bbe7-26d7920d041c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:18.791720 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-1ebd373d-f332-46fa-bbe7-26d7920d041c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:18.793212 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-1ebd373d-f332-46fa-bbe7-26d7920d041c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:18.794357 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-1ebd373d-f332-46fa-bbe7-26d7920d041c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1724 microversion: 2.20 time: 0.156776 Mar 31 18:23:18.794932 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 396/778] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:23:18 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:23:18.812341 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-e867fffa-e178-4949-a5df-a743f2e74568 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "9c083a52-6b40-4f73-9686-0e5dd95331a5"}} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:23:18.813490 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-e867fffa-e178-4949-a5df-a743f2e74568 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:23:18.819516 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e867fffa-e178-4949-a5df-a743f2e74568 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:18.819952 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e867fffa-e178-4949-a5df-a743f2e74568 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:18.820881 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e867fffa-e178-4949-a5df-a743f2e74568 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:18.821364 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e867fffa-e178-4949-a5df-a743f2e74568 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:19.171882 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [req-2dee1a0d-f1c5-413e-9af2-e1c9d2431a29 req-e1157387-70c7-447c-83e3-baa7ac5d808c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e404c053-bc21-4cf0-9ba6-07e6971e588f", "name": "network-vif-unplugged", "status": "completed", "tag": "af48c6cc-61d7-40f4-85b0-60adf2267642"}]} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:23:19.179960 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-2dee1a0d-f1c5-413e-9af2-e1c9d2431a29 req-e1157387-70c7-447c-83e3-baa7ac5d808c service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:19.180402 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-2dee1a0d-f1c5-413e-9af2-e1c9d2431a29 req-e1157387-70c7-447c-83e3-baa7ac5d808c service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:19.191326 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.compute.server_external_events [req-2dee1a0d-f1c5-413e-9af2-e1c9d2431a29 req-e1157387-70c7-447c-83e3-baa7ac5d808c service nova] Unable to find a host for instance e404c053-bc21-4cf0-9ba6-07e6971e588f. Dropping event network-vif-unplugged {{(pid=117538) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Mar 31 18:23:19.192192 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [req-2dee1a0d-f1c5-413e-9af2-e1c9d2431a29 req-e1157387-70c7-447c-83e3-baa7ac5d808c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.024230 Mar 31 18:23:19.192761 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 397/779] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:23:19 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 25 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Mar 31 18:23:19.777153 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-e867fffa-e178-4949-a5df-a743f2e74568 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "POST /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.968718 Mar 31 18:23:19.779493 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 383/780] 10.222.0.58 () {62 vars in 1363 bytes} [Thu Mar 31 18:23:18 2022] POST /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f/os-volume_attachments => generated 188 bytes in 970 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Mar 31 18:23:19.888041 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-cecf48e4-a204-4404-a10d-9cc2901a668c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:23:19.890903 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-cecf48e4-a204-4404-a10d-9cc2901a668c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:23:19.894443 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-cecf48e4-a204-4404-a10d-9cc2901a668c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:19.894921 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-cecf48e4-a204-4404-a10d-9cc2901a668c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:19.895678 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-cecf48e4-a204-4404-a10d-9cc2901a668c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:19.896108 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-cecf48e4-a204-4404-a10d-9cc2901a668c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:20.445847 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-cecf48e4-a204-4404-a10d-9cc2901a668c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f/os-volume_attachments/9c083a52-6b40-4f73-9686-0e5dd95331a5" status: 202 len: 0 microversion: 2.20 time: 0.562477 Mar 31 18:23:20.446448 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 398/781] 10.222.0.58 () {60 vars in 1456 bytes} [Thu Mar 31 18:23:19 2022] DELETE /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f/os-volume_attachments/9c083a52-6b40-4f73-9686-0e5dd95331a5 => generated 0 bytes in 564 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Mar 31 18:23:20.502344 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-28d90224-e25d-43c0-abed-9ca46252d6c7 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:23:20.502932 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-28d90224-e25d-43c0-abed-9ca46252d6c7 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:23:20.508768 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-28d90224-e25d-43c0-abed-9ca46252d6c7 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:20.509208 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-28d90224-e25d-43c0-abed-9ca46252d6c7 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:20.510060 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-28d90224-e25d-43c0-abed-9ca46252d6c7 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:20.510444 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-28d90224-e25d-43c0-abed-9ca46252d6c7 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:20.750467 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-28d90224-e25d-43c0-abed-9ca46252d6c7 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "POST /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f/action" status: 202 len: 0 microversion: 2.20 time: 0.252199 Mar 31 18:23:20.751110 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 384/782] 10.222.0.58 () {62 vars in 1318 bytes} [Thu Mar 31 18:23:20 2022] POST /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f/action => generated 0 bytes in 253 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Mar 31 18:23:20.760107 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-a7824525-c990-42b9-a912-838095078b06 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:23:20.760706 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-a7824525-c990-42b9-a912-838095078b06 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:23:20.767195 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a7824525-c990-42b9-a912-838095078b06 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:20.767639 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a7824525-c990-42b9-a912-838095078b06 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:20.768399 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a7824525-c990-42b9-a912-838095078b06 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:20.768826 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a7824525-c990-42b9-a912-838095078b06 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:20.902494 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-a7824525-c990-42b9-a912-838095078b06 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:20.910540 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-a7824525-c990-42b9-a912-838095078b06 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:20.913322 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-a7824525-c990-42b9-a912-838095078b06 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:20.913322 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-a7824525-c990-42b9-a912-838095078b06 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1672 microversion: 2.20 time: 0.157824 Mar 31 18:23:20.913839 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 399/783] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:23:20 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1672 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 31 18:23:21.932825 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-e329df70-d2f7-421d-95c4-2f68b61bf2a4 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:23:21.933432 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-e329df70-d2f7-421d-95c4-2f68b61bf2a4 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:23:21.939275 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e329df70-d2f7-421d-95c4-2f68b61bf2a4 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:21.939740 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e329df70-d2f7-421d-95c4-2f68b61bf2a4 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:21.940557 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e329df70-d2f7-421d-95c4-2f68b61bf2a4 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:21.940986 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e329df70-d2f7-421d-95c4-2f68b61bf2a4 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:22.082058 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-e329df70-d2f7-421d-95c4-2f68b61bf2a4 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:22.090178 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-e329df70-d2f7-421d-95c4-2f68b61bf2a4 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:22.091739 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-e329df70-d2f7-421d-95c4-2f68b61bf2a4 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:22.092955 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-e329df70-d2f7-421d-95c4-2f68b61bf2a4 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1674 microversion: 2.20 time: 0.165081 Mar 31 18:23:22.093506 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 385/784] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:23:21 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1674 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:23:23.112263 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-3e467048-d2cd-4b6b-abb5-6cd980be7f08 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:23:23.112897 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-3e467048-d2cd-4b6b-abb5-6cd980be7f08 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:23:23.119861 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3e467048-d2cd-4b6b-abb5-6cd980be7f08 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:23.120430 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3e467048-d2cd-4b6b-abb5-6cd980be7f08 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:23.121208 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3e467048-d2cd-4b6b-abb5-6cd980be7f08 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:23.121651 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3e467048-d2cd-4b6b-abb5-6cd980be7f08 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:23.257800 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-3e467048-d2cd-4b6b-abb5-6cd980be7f08 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:23.267118 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-3e467048-d2cd-4b6b-abb5-6cd980be7f08 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:23.268603 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-3e467048-d2cd-4b6b-abb5-6cd980be7f08 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:23.269737 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-3e467048-d2cd-4b6b-abb5-6cd980be7f08 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1730 microversion: 2.20 time: 0.161433 Mar 31 18:23:23.270362 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 400/785] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:23:23 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:23:24.287883 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-a258d374-9683-4b72-8984-a32994d1ec91 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:23:24.288480 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-a258d374-9683-4b72-8984-a32994d1ec91 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:23:24.295154 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a258d374-9683-4b72-8984-a32994d1ec91 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:24.295647 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a258d374-9683-4b72-8984-a32994d1ec91 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:24.296443 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a258d374-9683-4b72-8984-a32994d1ec91 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:24.296997 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a258d374-9683-4b72-8984-a32994d1ec91 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:24.436989 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-a258d374-9683-4b72-8984-a32994d1ec91 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:24.445271 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-a258d374-9683-4b72-8984-a32994d1ec91 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:24.447029 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-a258d374-9683-4b72-8984-a32994d1ec91 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:24.448986 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-a258d374-9683-4b72-8984-a32994d1ec91 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1730 microversion: 2.20 time: 0.164880 Mar 31 18:23:24.449546 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 386/786] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:23:24 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1730 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:23:25.467630 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-7a9ea2d6-3bc1-41f7-96e4-a46793f1ea8c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:23:25.468437 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-7a9ea2d6-3bc1-41f7-96e4-a46793f1ea8c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:23:25.474652 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-7a9ea2d6-3bc1-41f7-96e4-a46793f1ea8c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:25.475314 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-7a9ea2d6-3bc1-41f7-96e4-a46793f1ea8c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:25.476083 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-7a9ea2d6-3bc1-41f7-96e4-a46793f1ea8c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:25.476514 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-7a9ea2d6-3bc1-41f7-96e4-a46793f1ea8c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:25.620668 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-7a9ea2d6-3bc1-41f7-96e4-a46793f1ea8c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:25.628933 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-7a9ea2d6-3bc1-41f7-96e4-a46793f1ea8c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:25.630416 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-7a9ea2d6-3bc1-41f7-96e4-a46793f1ea8c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:25.631590 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-7a9ea2d6-3bc1-41f7-96e4-a46793f1ea8c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1730 microversion: 2.20 time: 0.168511 Mar 31 18:23:25.632283 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 401/787] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:23:25 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1730 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:23:26.650776 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-697576b8-63f7-429b-9882-1db46998ac87 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:23:26.651486 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-697576b8-63f7-429b-9882-1db46998ac87 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:23:26.657463 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-697576b8-63f7-429b-9882-1db46998ac87 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:26.657915 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-697576b8-63f7-429b-9882-1db46998ac87 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:26.658716 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-697576b8-63f7-429b-9882-1db46998ac87 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:26.659149 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-697576b8-63f7-429b-9882-1db46998ac87 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:26.802034 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-697576b8-63f7-429b-9882-1db46998ac87 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:26.810246 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-697576b8-63f7-429b-9882-1db46998ac87 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:26.811783 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-697576b8-63f7-429b-9882-1db46998ac87 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:26.812918 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-697576b8-63f7-429b-9882-1db46998ac87 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1730 microversion: 2.20 time: 0.166300 Mar 31 18:23:26.813795 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 387/788] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:23:26 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:23:27.831505 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-5833a914-8f28-4cd5-8296-7a8cd335b3a0 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:23:27.832131 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-5833a914-8f28-4cd5-8296-7a8cd335b3a0 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:23:27.838417 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-5833a914-8f28-4cd5-8296-7a8cd335b3a0 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:27.838896 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-5833a914-8f28-4cd5-8296-7a8cd335b3a0 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:27.840349 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-5833a914-8f28-4cd5-8296-7a8cd335b3a0 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:27.840787 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-5833a914-8f28-4cd5-8296-7a8cd335b3a0 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:27.983911 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-5833a914-8f28-4cd5-8296-7a8cd335b3a0 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:27.992184 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-5833a914-8f28-4cd5-8296-7a8cd335b3a0 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:27.993815 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-5833a914-8f28-4cd5-8296-7a8cd335b3a0 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:27.995209 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-5833a914-8f28-4cd5-8296-7a8cd335b3a0 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1730 microversion: 2.20 time: 0.167624 Mar 31 18:23:27.996115 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 402/789] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:23:27 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:23:29.014994 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-66808613-c6c9-4a2a-b522-fd53bd12a249 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:23:29.121762 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-66808613-c6c9-4a2a-b522-fd53bd12a249 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:23:29.121762 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-66808613-c6c9-4a2a-b522-fd53bd12a249 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:29.121762 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-66808613-c6c9-4a2a-b522-fd53bd12a249 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:29.121762 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-66808613-c6c9-4a2a-b522-fd53bd12a249 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:29.122593 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-66808613-c6c9-4a2a-b522-fd53bd12a249 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:29.193369 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-66808613-c6c9-4a2a-b522-fd53bd12a249 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:29.202981 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-66808613-c6c9-4a2a-b522-fd53bd12a249 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:29.204617 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-66808613-c6c9-4a2a-b522-fd53bd12a249 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:29.206067 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-66808613-c6c9-4a2a-b522-fd53bd12a249 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1730 microversion: 2.20 time: 0.196562 Mar 31 18:23:29.207115 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 388/790] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:23:29 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1730 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:23:29.537816 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-2ff23b90-2267-477b-b8dd-43504810c2af tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:23:29.538418 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-2ff23b90-2267-477b-b8dd-43504810c2af tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:23:29.545278 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-2ff23b90-2267-477b-b8dd-43504810c2af tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:29.545727 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-2ff23b90-2267-477b-b8dd-43504810c2af tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:29.546500 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-2ff23b90-2267-477b-b8dd-43504810c2af tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:29.546960 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-2ff23b90-2267-477b-b8dd-43504810c2af tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:29.570488 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-2ff23b90-2267-477b-b8dd-43504810c2af tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58/ips" status: 200 len: 147 microversion: 2.1 time: 0.036471 Mar 31 18:23:29.571094 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 403/791] 10.222.0.58 () {58 vars in 1247 bytes} [Thu Mar 31 18:23:29 2022] GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58/ips => generated 147 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:23:30.225024 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-5fdae080-cea8-401e-98e5-9c9fb8b68d44 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:23:30.225703 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-5fdae080-cea8-401e-98e5-9c9fb8b68d44 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:23:30.232354 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-5fdae080-cea8-401e-98e5-9c9fb8b68d44 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:30.232354 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-5fdae080-cea8-401e-98e5-9c9fb8b68d44 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:30.233032 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-5fdae080-cea8-401e-98e5-9c9fb8b68d44 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:30.233461 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-5fdae080-cea8-401e-98e5-9c9fb8b68d44 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:30.378520 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-5fdae080-cea8-401e-98e5-9c9fb8b68d44 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:30.386373 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-5fdae080-cea8-401e-98e5-9c9fb8b68d44 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:30.388339 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-5fdae080-cea8-401e-98e5-9c9fb8b68d44 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:30.389510 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-5fdae080-cea8-401e-98e5-9c9fb8b68d44 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1730 microversion: 2.20 time: 0.168351 Mar 31 18:23:30.390150 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 389/792] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:23:30 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:23:31.408873 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-901876a4-9a99-4df1-95d5-9e9917e38e77 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:23:31.409509 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-901876a4-9a99-4df1-95d5-9e9917e38e77 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:23:31.416072 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-901876a4-9a99-4df1-95d5-9e9917e38e77 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:31.416506 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-901876a4-9a99-4df1-95d5-9e9917e38e77 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:31.417257 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-901876a4-9a99-4df1-95d5-9e9917e38e77 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:31.417681 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-901876a4-9a99-4df1-95d5-9e9917e38e77 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:31.560195 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-901876a4-9a99-4df1-95d5-9e9917e38e77 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:31.568629 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-901876a4-9a99-4df1-95d5-9e9917e38e77 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:31.570159 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-901876a4-9a99-4df1-95d5-9e9917e38e77 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:31.571341 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-901876a4-9a99-4df1-95d5-9e9917e38e77 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1730 microversion: 2.20 time: 0.166648 Mar 31 18:23:31.571890 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 404/793] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:23:31 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 31 18:23:32.590513 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-d5ae123b-bfcc-4872-ab66-71a0061b9def tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:23:32.591416 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-d5ae123b-bfcc-4872-ab66-71a0061b9def tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:23:32.597722 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-d5ae123b-bfcc-4872-ab66-71a0061b9def tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:32.598164 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-d5ae123b-bfcc-4872-ab66-71a0061b9def tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:32.598999 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-d5ae123b-bfcc-4872-ab66-71a0061b9def tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:32.599430 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-d5ae123b-bfcc-4872-ab66-71a0061b9def tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:32.753316 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-d5ae123b-bfcc-4872-ab66-71a0061b9def tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:32.761508 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-d5ae123b-bfcc-4872-ab66-71a0061b9def tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:32.763509 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-d5ae123b-bfcc-4872-ab66-71a0061b9def tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:32.764657 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-d5ae123b-bfcc-4872-ab66-71a0061b9def tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1730 microversion: 2.20 time: 0.178093 Mar 31 18:23:32.765207 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 390/794] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:23:32 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1730 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:23:33.253191 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-5b62ade0-5c5f-40a9-ba9b-592fd3913b12 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "83ec71a7-25e5-4585-904f-ade2d0e58dd9"}} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:23:33.254313 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-5b62ade0-5c5f-40a9-ba9b-592fd3913b12 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:23:33.260306 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-5b62ade0-5c5f-40a9-ba9b-592fd3913b12 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:33.260748 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-5b62ade0-5c5f-40a9-ba9b-592fd3913b12 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:33.261508 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-5b62ade0-5c5f-40a9-ba9b-592fd3913b12 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:33.261937 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-5b62ade0-5c5f-40a9-ba9b-592fd3913b12 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:33.785959 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-ed0712a4-e8b4-4b04-8477-1e33bc5ea134 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:23:33.786770 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-ed0712a4-e8b4-4b04-8477-1e33bc5ea134 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:23:33.793398 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ed0712a4-e8b4-4b04-8477-1e33bc5ea134 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:33.794135 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ed0712a4-e8b4-4b04-8477-1e33bc5ea134 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:33.794921 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ed0712a4-e8b4-4b04-8477-1e33bc5ea134 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:33.795348 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ed0712a4-e8b4-4b04-8477-1e33bc5ea134 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:33.933136 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-ed0712a4-e8b4-4b04-8477-1e33bc5ea134 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:33.941132 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-ed0712a4-e8b4-4b04-8477-1e33bc5ea134 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:33.942633 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-ed0712a4-e8b4-4b04-8477-1e33bc5ea134 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:33.943797 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-ed0712a4-e8b4-4b04-8477-1e33bc5ea134 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1730 microversion: 2.20 time: 0.163061 Mar 31 18:23:33.944695 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 391/795] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:23:33 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 31 18:23:34.962892 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-efb6218f-5244-45d7-9f2e-72aa7a4638ae tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:23:34.963612 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-efb6218f-5244-45d7-9f2e-72aa7a4638ae tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:23:34.969974 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-efb6218f-5244-45d7-9f2e-72aa7a4638ae tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:34.970419 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-efb6218f-5244-45d7-9f2e-72aa7a4638ae tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:34.972364 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-efb6218f-5244-45d7-9f2e-72aa7a4638ae tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:34.972929 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-efb6218f-5244-45d7-9f2e-72aa7a4638ae tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:35.110996 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-efb6218f-5244-45d7-9f2e-72aa7a4638ae tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:35.118774 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-efb6218f-5244-45d7-9f2e-72aa7a4638ae tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:35.120250 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-efb6218f-5244-45d7-9f2e-72aa7a4638ae tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:35.121492 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-efb6218f-5244-45d7-9f2e-72aa7a4638ae tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1730 microversion: 2.20 time: 0.162627 Mar 31 18:23:35.122586 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 392/796] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:23:34 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1730 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 31 18:23:36.140552 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-9e35e4a9-14a1-4f42-ac58-b1e9ad86b0fb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:23:36.141204 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-9e35e4a9-14a1-4f42-ac58-b1e9ad86b0fb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:23:36.146963 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9e35e4a9-14a1-4f42-ac58-b1e9ad86b0fb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:36.147405 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9e35e4a9-14a1-4f42-ac58-b1e9ad86b0fb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:36.148154 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9e35e4a9-14a1-4f42-ac58-b1e9ad86b0fb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:36.148581 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9e35e4a9-14a1-4f42-ac58-b1e9ad86b0fb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:36.283227 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-9e35e4a9-14a1-4f42-ac58-b1e9ad86b0fb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:36.291091 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-9e35e4a9-14a1-4f42-ac58-b1e9ad86b0fb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:36.300924 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-9e35e4a9-14a1-4f42-ac58-b1e9ad86b0fb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:36.300924 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-9e35e4a9-14a1-4f42-ac58-b1e9ad86b0fb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1730 microversion: 2.20 time: 0.157409 Mar 31 18:23:36.300924 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 393/797] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:23:36 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:23:37.312970 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-71e5313e-359e-4efe-8cc7-9d97c3635d13 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:23:37.314260 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-71e5313e-359e-4efe-8cc7-9d97c3635d13 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:23:37.320289 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-71e5313e-359e-4efe-8cc7-9d97c3635d13 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:37.320729 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-71e5313e-359e-4efe-8cc7-9d97c3635d13 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:37.321496 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-71e5313e-359e-4efe-8cc7-9d97c3635d13 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:37.321911 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-71e5313e-359e-4efe-8cc7-9d97c3635d13 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:37.458602 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-71e5313e-359e-4efe-8cc7-9d97c3635d13 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:37.466467 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-71e5313e-359e-4efe-8cc7-9d97c3635d13 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:37.467982 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-71e5313e-359e-4efe-8cc7-9d97c3635d13 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:37.469114 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-71e5313e-359e-4efe-8cc7-9d97c3635d13 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1730 microversion: 2.20 time: 0.160340 Mar 31 18:23:37.469672 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 394/798] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:23:37 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1730 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 31 18:23:38.156653 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-5b62ade0-5c5f-40a9-ba9b-592fd3913b12 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "POST /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 4.910005 Mar 31 18:23:38.157268 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 405/799] 10.222.0.58 () {60 vars in 1322 bytes} [Thu Mar 31 18:23:33 2022] POST /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58/os-volume_attachments => generated 194 bytes in 4911 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:23:38.487705 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-ccd9fc2c-acfd-42bd-a0ba-0e52e6a06b3e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:23:38.488309 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-ccd9fc2c-acfd-42bd-a0ba-0e52e6a06b3e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:23:38.493911 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ccd9fc2c-acfd-42bd-a0ba-0e52e6a06b3e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:38.494349 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ccd9fc2c-acfd-42bd-a0ba-0e52e6a06b3e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:38.495131 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ccd9fc2c-acfd-42bd-a0ba-0e52e6a06b3e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:38.495555 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ccd9fc2c-acfd-42bd-a0ba-0e52e6a06b3e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:38.630144 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-ccd9fc2c-acfd-42bd-a0ba-0e52e6a06b3e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:38.638076 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-ccd9fc2c-acfd-42bd-a0ba-0e52e6a06b3e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:38.639591 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-ccd9fc2c-acfd-42bd-a0ba-0e52e6a06b3e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:38.640722 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-ccd9fc2c-acfd-42bd-a0ba-0e52e6a06b3e tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1730 microversion: 2.20 time: 0.156873 Mar 31 18:23:38.641276 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 395/800] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:23:38 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1730 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 31 18:23:39.660207 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-0f18c2fd-4c31-49bb-b57f-934680297caf tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:23:39.660796 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-0f18c2fd-4c31-49bb-b57f-934680297caf tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:23:39.667506 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-0f18c2fd-4c31-49bb-b57f-934680297caf tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:39.667952 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-0f18c2fd-4c31-49bb-b57f-934680297caf tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:39.668729 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-0f18c2fd-4c31-49bb-b57f-934680297caf tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:39.669266 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-0f18c2fd-4c31-49bb-b57f-934680297caf tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:39.804788 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-0f18c2fd-4c31-49bb-b57f-934680297caf tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:39.813675 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-0f18c2fd-4c31-49bb-b57f-934680297caf tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:39.815253 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-0f18c2fd-4c31-49bb-b57f-934680297caf tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:39.816406 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-0f18c2fd-4c31-49bb-b57f-934680297caf tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1730 microversion: 2.20 time: 0.161172 Mar 31 18:23:39.817047 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 406/801] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:23:39 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:23:40.834759 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-2cc52d48-c21a-4e29-9749-787442660bfc tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:23:40.835304 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-2cc52d48-c21a-4e29-9749-787442660bfc tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:23:40.841764 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-2cc52d48-c21a-4e29-9749-787442660bfc tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:40.842287 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-2cc52d48-c21a-4e29-9749-787442660bfc tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:40.843072 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-2cc52d48-c21a-4e29-9749-787442660bfc tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:40.843506 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-2cc52d48-c21a-4e29-9749-787442660bfc tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:40.972860 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-2cc52d48-c21a-4e29-9749-787442660bfc tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:40.980387 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-2cc52d48-c21a-4e29-9749-787442660bfc tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:40.981987 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-2cc52d48-c21a-4e29-9749-787442660bfc tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:40.983151 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-2cc52d48-c21a-4e29-9749-787442660bfc tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1730 microversion: 2.20 time: 0.152385 Mar 31 18:23:40.983739 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 396/802] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:23:40 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:23:42.001522 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-6b8e5ae0-0c9d-4ca8-8a6f-8346c0359e5c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:23:42.002129 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-6b8e5ae0-0c9d-4ca8-8a6f-8346c0359e5c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:23:42.008449 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6b8e5ae0-0c9d-4ca8-8a6f-8346c0359e5c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:42.008890 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6b8e5ae0-0c9d-4ca8-8a6f-8346c0359e5c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:42.009646 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6b8e5ae0-0c9d-4ca8-8a6f-8346c0359e5c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:42.010076 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6b8e5ae0-0c9d-4ca8-8a6f-8346c0359e5c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:42.147731 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-6b8e5ae0-0c9d-4ca8-8a6f-8346c0359e5c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:42.156206 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-6b8e5ae0-0c9d-4ca8-8a6f-8346c0359e5c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:42.157837 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-6b8e5ae0-0c9d-4ca8-8a6f-8346c0359e5c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:42.159036 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-6b8e5ae0-0c9d-4ca8-8a6f-8346c0359e5c tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1730 microversion: 2.20 time: 0.161437 Mar 31 18:23:42.159596 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 407/803] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:23:41 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:23:43.176417 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-0059dda6-8250-436f-a5ee-4ebcb2c1cd39 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:23:43.177017 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-0059dda6-8250-436f-a5ee-4ebcb2c1cd39 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:23:43.182952 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0059dda6-8250-436f-a5ee-4ebcb2c1cd39 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:43.183391 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0059dda6-8250-436f-a5ee-4ebcb2c1cd39 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:43.184168 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0059dda6-8250-436f-a5ee-4ebcb2c1cd39 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:43.184656 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0059dda6-8250-436f-a5ee-4ebcb2c1cd39 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:43.274034 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [req-76ca980e-ca05-4be1-8ea2-74f00a4f5cbc req-7dbe8bd3-6dfa-4c53-b629-509b177e5119 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e404c053-bc21-4cf0-9ba6-07e6971e588f", "name": "network-vif-plugged", "status": "completed", "tag": "af48c6cc-61d7-40f4-85b0-60adf2267642"}]} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:23:43.286357 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-76ca980e-ca05-4be1-8ea2-74f00a4f5cbc req-7dbe8bd3-6dfa-4c53-b629-509b177e5119 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:43.286834 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-76ca980e-ca05-4be1-8ea2-74f00a4f5cbc req-7dbe8bd3-6dfa-4c53-b629-509b177e5119 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:43.298205 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.compute.server_external_events [req-76ca980e-ca05-4be1-8ea2-74f00a4f5cbc req-7dbe8bd3-6dfa-4c53-b629-509b177e5119 service nova] Creating event network-vif-plugged:af48c6cc-61d7-40f4-85b0-60adf2267642 for instance e404c053-bc21-4cf0-9ba6-07e6971e588f on hv-cinder-maste Mar 31 18:23:43.303147 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [req-76ca980e-ca05-4be1-8ea2-74f00a4f5cbc req-7dbe8bd3-6dfa-4c53-b629-509b177e5119 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033027 Mar 31 18:23:43.303936 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 408/804] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:23:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 31 18:23:43.390986 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-0059dda6-8250-436f-a5ee-4ebcb2c1cd39 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:43.401566 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-0059dda6-8250-436f-a5ee-4ebcb2c1cd39 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:43.403606 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-0059dda6-8250-436f-a5ee-4ebcb2c1cd39 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:43.404997 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-0059dda6-8250-436f-a5ee-4ebcb2c1cd39 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1730 microversion: 2.20 time: 0.232528 Mar 31 18:23:43.405803 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 397/805] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:23:43 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1730 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:23:44.424774 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-32c67ac9-fec0-4c78-b266-1c822ec84a38 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:23:44.425368 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-32c67ac9-fec0-4c78-b266-1c822ec84a38 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:23:44.431397 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-32c67ac9-fec0-4c78-b266-1c822ec84a38 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:44.431842 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-32c67ac9-fec0-4c78-b266-1c822ec84a38 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:44.432588 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-32c67ac9-fec0-4c78-b266-1c822ec84a38 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:44.433012 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-32c67ac9-fec0-4c78-b266-1c822ec84a38 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:44.709270 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-32c67ac9-fec0-4c78-b266-1c822ec84a38 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:44.717883 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-32c67ac9-fec0-4c78-b266-1c822ec84a38 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:44.721678 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-32c67ac9-fec0-4c78-b266-1c822ec84a38 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:44.721678 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-32c67ac9-fec0-4c78-b266-1c822ec84a38 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1730 microversion: 2.20 time: 0.300681 Mar 31 18:23:44.721678 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 409/806] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:23:44 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1730 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:23:45.738835 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-82182f03-5e86-432c-999c-0b519c2e6d83 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:23:45.739586 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-82182f03-5e86-432c-999c-0b519c2e6d83 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:23:45.745286 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-82182f03-5e86-432c-999c-0b519c2e6d83 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:45.745726 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-82182f03-5e86-432c-999c-0b519c2e6d83 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:45.746513 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-82182f03-5e86-432c-999c-0b519c2e6d83 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:45.746979 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-82182f03-5e86-432c-999c-0b519c2e6d83 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:45.885379 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-82182f03-5e86-432c-999c-0b519c2e6d83 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:45.894385 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-82182f03-5e86-432c-999c-0b519c2e6d83 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:45.895903 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-82182f03-5e86-432c-999c-0b519c2e6d83 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:45.899868 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-82182f03-5e86-432c-999c-0b519c2e6d83 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1730 microversion: 2.20 time: 0.162136 Mar 31 18:23:45.899868 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 398/807] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:23:45 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:23:46.689635 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-d4609c63-63f8-4c6b-8430-1f891292cf3b tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:23:46.696096 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-d4609c63-63f8-4c6b-8430-1f891292cf3b tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:46.696538 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-d4609c63-63f8-4c6b-8430-1f891292cf3b tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:46.758521 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-d4609c63-63f8-4c6b-8430-1f891292cf3b tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Going to try to stop instance {{(pid=117538) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Mar 31 18:23:46.889569 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-d4609c63-63f8-4c6b-8430-1f891292cf3b tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "POST /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58/action" status: 202 len: 0 microversion: 2.1 time: 0.203466 Mar 31 18:23:46.890198 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 410/808] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Mar 31 18:23:46 2022] POST /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58/action => generated 0 bytes in 206 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 31 18:23:46.902799 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-3e96d1c0-af4c-4928-9df8-bb619e379204 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:23:46.904249 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-3e96d1c0-af4c-4928-9df8-bb619e379204 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:23:46.910277 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3e96d1c0-af4c-4928-9df8-bb619e379204 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:46.913476 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3e96d1c0-af4c-4928-9df8-bb619e379204 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:46.913476 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3e96d1c0-af4c-4928-9df8-bb619e379204 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:46.913476 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3e96d1c0-af4c-4928-9df8-bb619e379204 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:46.915740 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-171fe4d4-a729-4748-982a-839163fce062 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:23:46.916624 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-171fe4d4-a729-4748-982a-839163fce062 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:23:46.923544 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-171fe4d4-a729-4748-982a-839163fce062 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:46.923851 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-171fe4d4-a729-4748-982a-839163fce062 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:46.924765 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-171fe4d4-a729-4748-982a-839163fce062 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:46.925198 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-171fe4d4-a729-4748-982a-839163fce062 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:47.049503 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-3e96d1c0-af4c-4928-9df8-bb619e379204 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:47.057515 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-3e96d1c0-af4c-4928-9df8-bb619e379204 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58" status: 200 len: 1724 microversion: 2.1 time: 0.158647 Mar 31 18:23:47.058175 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 399/809] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:23:46 2022] GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:23:47.065264 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-171fe4d4-a729-4748-982a-839163fce062 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:47.073066 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-171fe4d4-a729-4748-982a-839163fce062 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:47.074547 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-171fe4d4-a729-4748-982a-839163fce062 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:47.075783 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-171fe4d4-a729-4748-982a-839163fce062 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1717 microversion: 2.20 time: 0.164465 Mar 31 18:23:47.076331 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 411/810] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:23:46 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1717 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 31 18:23:48.075862 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-af4e871d-a28d-4816-b278-b6a1500d3a50 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:23:48.076457 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-af4e871d-a28d-4816-b278-b6a1500d3a50 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:23:48.082438 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-af4e871d-a28d-4816-b278-b6a1500d3a50 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:48.082953 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-af4e871d-a28d-4816-b278-b6a1500d3a50 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:48.083649 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-af4e871d-a28d-4816-b278-b6a1500d3a50 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:48.084070 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-af4e871d-a28d-4816-b278-b6a1500d3a50 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:48.219722 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-af4e871d-a28d-4816-b278-b6a1500d3a50 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:48.227486 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-af4e871d-a28d-4816-b278-b6a1500d3a50 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58" status: 200 len: 1724 microversion: 2.1 time: 0.155509 Mar 31 18:23:48.228049 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 400/811] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:23:48 2022] GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:23:49.245278 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-671ed65d-df21-472f-b73c-7be74978d0da tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:23:49.245895 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-671ed65d-df21-472f-b73c-7be74978d0da tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:23:49.252739 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-671ed65d-df21-472f-b73c-7be74978d0da tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:49.253182 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-671ed65d-df21-472f-b73c-7be74978d0da tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:49.253946 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-671ed65d-df21-472f-b73c-7be74978d0da tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:49.254421 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-671ed65d-df21-472f-b73c-7be74978d0da tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:49.390049 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-671ed65d-df21-472f-b73c-7be74978d0da tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:49.397750 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-671ed65d-df21-472f-b73c-7be74978d0da tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58" status: 200 len: 1724 microversion: 2.1 time: 0.156435 Mar 31 18:23:49.398313 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 412/812] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:23:49 2022] GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:23:50.415458 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-dfc623f9-dafa-48bd-8edd-21e2c2c40c28 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:23:50.416012 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-dfc623f9-dafa-48bd-8edd-21e2c2c40c28 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:23:50.422478 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-dfc623f9-dafa-48bd-8edd-21e2c2c40c28 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:50.422941 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-dfc623f9-dafa-48bd-8edd-21e2c2c40c28 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:50.423670 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-dfc623f9-dafa-48bd-8edd-21e2c2c40c28 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:50.424088 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-dfc623f9-dafa-48bd-8edd-21e2c2c40c28 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:50.563658 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-dfc623f9-dafa-48bd-8edd-21e2c2c40c28 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:50.571389 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-dfc623f9-dafa-48bd-8edd-21e2c2c40c28 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58" status: 200 len: 1724 microversion: 2.1 time: 0.159875 Mar 31 18:23:50.571947 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 401/813] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:23:50 2022] GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:23:51.588493 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-103121c0-f29b-4981-a6f9-b6723c11b5d8 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:23:51.589121 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-103121c0-f29b-4981-a6f9-b6723c11b5d8 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:23:51.596054 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-103121c0-f29b-4981-a6f9-b6723c11b5d8 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:51.596500 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-103121c0-f29b-4981-a6f9-b6723c11b5d8 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:51.597260 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-103121c0-f29b-4981-a6f9-b6723c11b5d8 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:51.597717 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-103121c0-f29b-4981-a6f9-b6723c11b5d8 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:51.729268 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-103121c0-f29b-4981-a6f9-b6723c11b5d8 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:51.738129 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-103121c0-f29b-4981-a6f9-b6723c11b5d8 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58" status: 200 len: 1724 microversion: 2.1 time: 0.153475 Mar 31 18:23:51.738709 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 413/814] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:23:51 2022] GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:23:52.755321 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-0ec585c9-16af-4b57-9a70-dde7e3d2a6da tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:23:52.755964 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-0ec585c9-16af-4b57-9a70-dde7e3d2a6da tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:23:52.762292 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0ec585c9-16af-4b57-9a70-dde7e3d2a6da tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:52.763091 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0ec585c9-16af-4b57-9a70-dde7e3d2a6da tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:52.763815 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0ec585c9-16af-4b57-9a70-dde7e3d2a6da tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:52.764235 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0ec585c9-16af-4b57-9a70-dde7e3d2a6da tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:52.897230 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-0ec585c9-16af-4b57-9a70-dde7e3d2a6da tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:52.905955 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-0ec585c9-16af-4b57-9a70-dde7e3d2a6da tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58" status: 200 len: 1724 microversion: 2.1 time: 0.154788 Mar 31 18:23:52.906528 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 402/815] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:23:52 2022] GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:23:53.922238 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-d91b7d48-e164-49de-a7ec-8b8ac51b264f tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:23:53.922874 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-d91b7d48-e164-49de-a7ec-8b8ac51b264f tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:23:53.929161 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-d91b7d48-e164-49de-a7ec-8b8ac51b264f tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:53.929599 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-d91b7d48-e164-49de-a7ec-8b8ac51b264f tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:53.930349 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-d91b7d48-e164-49de-a7ec-8b8ac51b264f tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:53.930810 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-d91b7d48-e164-49de-a7ec-8b8ac51b264f tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:54.069318 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-d91b7d48-e164-49de-a7ec-8b8ac51b264f tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:54.077182 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-d91b7d48-e164-49de-a7ec-8b8ac51b264f tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58" status: 200 len: 1724 microversion: 2.1 time: 0.158937 Mar 31 18:23:54.077752 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 414/816] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:23:53 2022] GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:23:55.095195 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-6a3ec745-8226-4a56-8e44-9af6265ac59c tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:23:55.096104 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-6a3ec745-8226-4a56-8e44-9af6265ac59c tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:23:55.101641 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-6a3ec745-8226-4a56-8e44-9af6265ac59c tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:55.102084 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-6a3ec745-8226-4a56-8e44-9af6265ac59c tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:55.102871 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-6a3ec745-8226-4a56-8e44-9af6265ac59c tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:55.103298 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-6a3ec745-8226-4a56-8e44-9af6265ac59c tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:55.234965 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-6a3ec745-8226-4a56-8e44-9af6265ac59c tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:55.242558 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-6a3ec745-8226-4a56-8e44-9af6265ac59c tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58" status: 200 len: 1724 microversion: 2.1 time: 0.151970 Mar 31 18:23:55.243138 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 403/817] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:23:55 2022] GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:23:56.259778 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-44dac625-b602-4063-84e3-67597fc63d14 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:23:56.260380 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-44dac625-b602-4063-84e3-67597fc63d14 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:23:56.267486 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-44dac625-b602-4063-84e3-67597fc63d14 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:56.267937 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-44dac625-b602-4063-84e3-67597fc63d14 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:56.268677 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-44dac625-b602-4063-84e3-67597fc63d14 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:56.269107 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-44dac625-b602-4063-84e3-67597fc63d14 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:56.400232 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-44dac625-b602-4063-84e3-67597fc63d14 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:56.408945 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-44dac625-b602-4063-84e3-67597fc63d14 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58" status: 200 len: 1724 microversion: 2.1 time: 0.153007 Mar 31 18:23:56.409506 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 415/818] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:23:56 2022] GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:23:57.425645 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-7930a64a-c0b2-4de5-ab75-310b71c64c4e tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:23:57.426210 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-7930a64a-c0b2-4de5-ab75-310b71c64c4e tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:23:57.432195 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-7930a64a-c0b2-4de5-ab75-310b71c64c4e tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:57.432647 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-7930a64a-c0b2-4de5-ab75-310b71c64c4e tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:57.433412 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-7930a64a-c0b2-4de5-ab75-310b71c64c4e tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:57.433847 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-7930a64a-c0b2-4de5-ab75-310b71c64c4e tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:57.565308 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-7930a64a-c0b2-4de5-ab75-310b71c64c4e tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:57.572984 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-7930a64a-c0b2-4de5-ab75-310b71c64c4e tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58" status: 200 len: 1724 microversion: 2.1 time: 0.151388 Mar 31 18:23:57.573545 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 404/819] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:23:57 2022] GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:23:58.591256 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-4515887b-82ea-4e1b-a733-0e3858966be8 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:23:58.591869 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-4515887b-82ea-4e1b-a733-0e3858966be8 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:23:58.598143 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4515887b-82ea-4e1b-a733-0e3858966be8 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:58.598573 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4515887b-82ea-4e1b-a733-0e3858966be8 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:58.599411 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4515887b-82ea-4e1b-a733-0e3858966be8 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:58.599845 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4515887b-82ea-4e1b-a733-0e3858966be8 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:58.730521 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-4515887b-82ea-4e1b-a733-0e3858966be8 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:58.738219 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-4515887b-82ea-4e1b-a733-0e3858966be8 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58" status: 200 len: 1724 microversion: 2.1 time: 0.151599 Mar 31 18:23:58.738805 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 416/820] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:23:58 2022] GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:23:59.755187 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-a568fdc0-985d-4f0b-a164-366c5dec0242 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:23:59.755793 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-a568fdc0-985d-4f0b-a164-366c5dec0242 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:23:59.761626 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a568fdc0-985d-4f0b-a164-366c5dec0242 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:59.762062 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a568fdc0-985d-4f0b-a164-366c5dec0242 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:59.763401 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a568fdc0-985d-4f0b-a164-366c5dec0242 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:23:59.763832 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a568fdc0-985d-4f0b-a164-366c5dec0242 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:23:59.895640 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-a568fdc0-985d-4f0b-a164-366c5dec0242 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:23:59.903865 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-a568fdc0-985d-4f0b-a164-366c5dec0242 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58" status: 200 len: 1724 microversion: 2.1 time: 0.151845 Mar 31 18:23:59.904592 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 405/821] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:23:59 2022] GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:24:00.921062 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-38b41a8e-795d-45cb-b3f4-9eb397f84dd1 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:24:00.921672 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-38b41a8e-795d-45cb-b3f4-9eb397f84dd1 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:24:00.927905 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-38b41a8e-795d-45cb-b3f4-9eb397f84dd1 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:24:00.928350 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-38b41a8e-795d-45cb-b3f4-9eb397f84dd1 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:24:00.929107 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-38b41a8e-795d-45cb-b3f4-9eb397f84dd1 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:24:00.929546 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-38b41a8e-795d-45cb-b3f4-9eb397f84dd1 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:24:01.063196 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-38b41a8e-795d-45cb-b3f4-9eb397f84dd1 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:24:01.070867 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-38b41a8e-795d-45cb-b3f4-9eb397f84dd1 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58" status: 200 len: 1724 microversion: 2.1 time: 0.153719 Mar 31 18:24:01.071431 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 417/822] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:24:00 2022] GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:24:02.088757 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-51df630b-73b4-46e7-99d3-8b88e1b93328 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:24:02.089385 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-51df630b-73b4-46e7-99d3-8b88e1b93328 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:24:02.095303 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-51df630b-73b4-46e7-99d3-8b88e1b93328 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:24:02.095738 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-51df630b-73b4-46e7-99d3-8b88e1b93328 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:24:02.096480 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-51df630b-73b4-46e7-99d3-8b88e1b93328 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:24:02.096904 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-51df630b-73b4-46e7-99d3-8b88e1b93328 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:24:02.228034 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-51df630b-73b4-46e7-99d3-8b88e1b93328 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:24:02.235922 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-51df630b-73b4-46e7-99d3-8b88e1b93328 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58" status: 200 len: 1724 microversion: 2.1 time: 0.150977 Mar 31 18:24:02.236485 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 406/823] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:24:02 2022] GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:24:03.253254 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-5fe43f4d-1253-4019-a587-d6a45174f635 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:24:03.253857 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-5fe43f4d-1253-4019-a587-d6a45174f635 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:24:03.260102 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-5fe43f4d-1253-4019-a587-d6a45174f635 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:24:03.260542 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-5fe43f4d-1253-4019-a587-d6a45174f635 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:24:03.261288 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-5fe43f4d-1253-4019-a587-d6a45174f635 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:24:03.261721 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-5fe43f4d-1253-4019-a587-d6a45174f635 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:24:03.398000 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-5fe43f4d-1253-4019-a587-d6a45174f635 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:24:03.406013 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-5fe43f4d-1253-4019-a587-d6a45174f635 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58" status: 200 len: 1701 microversion: 2.1 time: 0.156667 Mar 31 18:24:03.406572 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 418/824] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:24:03 2022] GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58 => generated 1701 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:24:03.422348 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-c0922172-99ac-416f-af68-6551422910d0 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:24:03.428322 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c0922172-99ac-416f-af68-6551422910d0 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:24:03.428758 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c0922172-99ac-416f-af68-6551422910d0 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:24:03.486889 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-c0922172-99ac-416f-af68-6551422910d0 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Going to try to start instance {{(pid=117539) start /opt/stack/nova/nova/compute/api.py:2730}} Mar 31 18:24:03.694582 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-c0922172-99ac-416f-af68-6551422910d0 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "POST /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58/action" status: 202 len: 0 microversion: 2.1 time: 0.276000 Mar 31 18:24:03.695229 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 407/825] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Mar 31 18:24:03 2022] POST /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58/action => generated 0 bytes in 278 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 31 18:24:03.703874 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-1bffedcf-0dd0-4ff5-a906-fcdca30788bf tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:24:03.704482 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-1bffedcf-0dd0-4ff5-a906-fcdca30788bf tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:24:03.710416 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-1bffedcf-0dd0-4ff5-a906-fcdca30788bf tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:24:03.714103 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-1bffedcf-0dd0-4ff5-a906-fcdca30788bf tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:24:03.714103 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-1bffedcf-0dd0-4ff5-a906-fcdca30788bf tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:24:03.714103 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-1bffedcf-0dd0-4ff5-a906-fcdca30788bf tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:24:03.850141 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-1bffedcf-0dd0-4ff5-a906-fcdca30788bf tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:24:03.858684 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-1bffedcf-0dd0-4ff5-a906-fcdca30788bf tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58" status: 200 len: 1710 microversion: 2.1 time: 0.159217 Mar 31 18:24:03.859255 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 419/826] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:24:03 2022] GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58 => generated 1710 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:24:04.877162 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-a538bce1-5bcc-456f-a16c-b96374ffa89c tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:24:04.877805 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-a538bce1-5bcc-456f-a16c-b96374ffa89c tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:24:04.883754 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a538bce1-5bcc-456f-a16c-b96374ffa89c tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:24:04.884189 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a538bce1-5bcc-456f-a16c-b96374ffa89c tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:24:04.884934 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a538bce1-5bcc-456f-a16c-b96374ffa89c tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:24:04.885357 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a538bce1-5bcc-456f-a16c-b96374ffa89c tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:24:05.022209 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-a538bce1-5bcc-456f-a16c-b96374ffa89c tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:24:05.030498 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-a538bce1-5bcc-456f-a16c-b96374ffa89c tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58" status: 200 len: 1710 microversion: 2.1 time: 0.157632 Mar 31 18:24:05.031099 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 408/827] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:24:04 2022] GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58 => generated 1710 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:24:06.049410 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-656e1496-e6f1-491d-9ae5-282830e1ebfd tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:24:06.050020 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-656e1496-e6f1-491d-9ae5-282830e1ebfd tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:24:06.056670 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-656e1496-e6f1-491d-9ae5-282830e1ebfd tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:24:06.057045 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-656e1496-e6f1-491d-9ae5-282830e1ebfd tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:24:06.057808 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-656e1496-e6f1-491d-9ae5-282830e1ebfd tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:24:06.058240 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-656e1496-e6f1-491d-9ae5-282830e1ebfd tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:24:06.194038 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-656e1496-e6f1-491d-9ae5-282830e1ebfd tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:24:06.202223 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-656e1496-e6f1-491d-9ae5-282830e1ebfd tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58" status: 200 len: 1714 microversion: 2.1 time: 0.156769 Mar 31 18:24:06.202818 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 420/828] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:24:06 2022] GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58 => generated 1714 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:24:09.619489 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 31 18:24:09.620154 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: Thu Mar 31 18:24:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 31 18:24:29.244279 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-7548f883-cc5c-4648-8434-7c715f54ddf3 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:24:29.244863 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-7548f883-cc5c-4648-8434-7c715f54ddf3 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:24:29.252282 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-7548f883-cc5c-4648-8434-7c715f54ddf3 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:24:29.252751 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-7548f883-cc5c-4648-8434-7c715f54ddf3 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:24:29.253637 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-7548f883-cc5c-4648-8434-7c715f54ddf3 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:24:29.254067 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-7548f883-cc5c-4648-8434-7c715f54ddf3 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:24:29.281767 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-7548f883-cc5c-4648-8434-7c715f54ddf3 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Going to try to terminate instance {{(pid=117539) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 31 18:24:29.312266 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [req-11a1f365-5302-4e5a-aecf-f79630095e36 req-3a1d1045-170a-49ff-b7a3-765f2df6a6f0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "61abeff2-268a-4149-9962-497c409663ed", "tag": "156f9ff9-ec0d-4ac3-a7d7-2fa14dbead9a"}]} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:24:29.320422 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-11a1f365-5302-4e5a-aecf-f79630095e36 req-3a1d1045-170a-49ff-b7a3-765f2df6a6f0 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:24:29.320951 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-11a1f365-5302-4e5a-aecf-f79630095e36 req-3a1d1045-170a-49ff-b7a3-765f2df6a6f0 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:24:29.332291 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.compute.server_external_events [req-11a1f365-5302-4e5a-aecf-f79630095e36 req-3a1d1045-170a-49ff-b7a3-765f2df6a6f0 service nova] Creating event network-changed:156f9ff9-ec0d-4ac3-a7d7-2fa14dbead9a for instance 61abeff2-268a-4149-9962-497c409663ed on hv-cinder-maste Mar 31 18:24:29.337507 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [req-11a1f365-5302-4e5a-aecf-f79630095e36 req-3a1d1045-170a-49ff-b7a3-765f2df6a6f0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.094979 Mar 31 18:24:29.338130 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 421/829] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:24:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 31 18:24:29.542755 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-7548f883-cc5c-4648-8434-7c715f54ddf3 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "DELETE /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 204 len: 0 microversion: 2.1 time: 0.302499 Mar 31 18:24:29.543916 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 409/830] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Mar 31 18:24:29 2022] DELETE /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 0 bytes in 305 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 31 18:24:29.553037 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-058c3d7c-1473-4640-9137-b419a3a17ffd tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:24:29.555552 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-058c3d7c-1473-4640-9137-b419a3a17ffd tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:24:29.563863 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-058c3d7c-1473-4640-9137-b419a3a17ffd tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:24:29.564372 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-058c3d7c-1473-4640-9137-b419a3a17ffd tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:24:29.565217 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-058c3d7c-1473-4640-9137-b419a3a17ffd tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:24:29.565762 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-058c3d7c-1473-4640-9137-b419a3a17ffd tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:24:29.769787 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-058c3d7c-1473-4640-9137-b419a3a17ffd tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:24:29.785075 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-058c3d7c-1473-4640-9137-b419a3a17ffd tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1567 microversion: 2.1 time: 0.236404 Mar 31 18:24:29.785665 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 422/831] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:24:29 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1567 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:24:30.805846 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-28c3241b-4284-4756-96e9-b9fd6a116488 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:24:30.806456 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-28c3241b-4284-4756-96e9-b9fd6a116488 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:24:30.812668 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-28c3241b-4284-4756-96e9-b9fd6a116488 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:24:30.813106 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-28c3241b-4284-4756-96e9-b9fd6a116488 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:24:30.813857 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-28c3241b-4284-4756-96e9-b9fd6a116488 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:24:30.814279 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-28c3241b-4284-4756-96e9-b9fd6a116488 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:24:30.949056 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-28c3241b-4284-4756-96e9-b9fd6a116488 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:24:30.956802 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-28c3241b-4284-4756-96e9-b9fd6a116488 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1449 microversion: 2.1 time: 0.155271 Mar 31 18:24:30.957358 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 410/832] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:24:30 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1449 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:24:31.975023 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-4e2963d8-4b03-481a-9a9f-1d1689f28c5d tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:24:31.977459 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-4e2963d8-4b03-481a-9a9f-1d1689f28c5d tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:24:31.982155 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4e2963d8-4b03-481a-9a9f-1d1689f28c5d tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:24:31.982636 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4e2963d8-4b03-481a-9a9f-1d1689f28c5d tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:24:31.983400 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4e2963d8-4b03-481a-9a9f-1d1689f28c5d tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:24:31.983854 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4e2963d8-4b03-481a-9a9f-1d1689f28c5d tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:24:32.252830 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-4e2963d8-4b03-481a-9a9f-1d1689f28c5d tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:24:32.260168 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-4e2963d8-4b03-481a-9a9f-1d1689f28c5d tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1449 microversion: 2.1 time: 0.289037 Mar 31 18:24:32.260735 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 423/833] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:24:31 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1449 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:24:32.419244 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [req-3978bfc7-eba1-4fae-a559-8635b8eca0aa req-95e694c6-00cf-4acd-9632-62fef1dd4160 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "61abeff2-268a-4149-9962-497c409663ed", "name": "network-vif-deleted", "tag": "156f9ff9-ec0d-4ac3-a7d7-2fa14dbead9a"}]} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:24:32.427399 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-3978bfc7-eba1-4fae-a559-8635b8eca0aa req-95e694c6-00cf-4acd-9632-62fef1dd4160 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:24:32.427833 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-3978bfc7-eba1-4fae-a559-8635b8eca0aa req-95e694c6-00cf-4acd-9632-62fef1dd4160 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:24:32.439424 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.compute.server_external_events [req-3978bfc7-eba1-4fae-a559-8635b8eca0aa req-95e694c6-00cf-4acd-9632-62fef1dd4160 service nova] Creating event network-vif-deleted:156f9ff9-ec0d-4ac3-a7d7-2fa14dbead9a for instance 61abeff2-268a-4149-9962-497c409663ed on hv-cinder-maste Mar 31 18:24:32.445084 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [req-3978bfc7-eba1-4fae-a559-8635b8eca0aa req-95e694c6-00cf-4acd-9632-62fef1dd4160 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030201 Mar 31 18:24:32.445385 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 411/834] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:24:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:24:33.277663 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-e0bbe060-4f9f-46d9-b6da-214bb91f61e7 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:24:33.278287 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-e0bbe060-4f9f-46d9-b6da-214bb91f61e7 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:24:33.285219 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e0bbe060-4f9f-46d9-b6da-214bb91f61e7 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:24:33.285606 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e0bbe060-4f9f-46d9-b6da-214bb91f61e7 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:24:33.286371 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e0bbe060-4f9f-46d9-b6da-214bb91f61e7 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:24:33.286827 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e0bbe060-4f9f-46d9-b6da-214bb91f61e7 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:24:33.347763 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-e0bbe060-4f9f-46d9-b6da-214bb91f61e7 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6f1d5c7f14e2491aa217a7d2939fe962', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '10c09876736547b59f4bb56fa5740f5f', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:24:33.355172 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-e0bbe060-4f9f-46d9-b6da-214bb91f61e7 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 200 len: 1219 microversion: 2.1 time: 0.081579 Mar 31 18:24:33.355763 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 424/835] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:24:33 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:24:34.372156 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-eb3f52a2-bd91-4d8b-bc3d-b2dbd9d79c67 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:24:34.372872 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-eb3f52a2-bd91-4d8b-bc3d-b2dbd9d79c67 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] [instance: 61abeff2-268a-4149-9962-497c409663ed] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:24:34.378937 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-eb3f52a2-bd91-4d8b-bc3d-b2dbd9d79c67 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:24:34.379384 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-eb3f52a2-bd91-4d8b-bc3d-b2dbd9d79c67 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:24:34.380133 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-eb3f52a2-bd91-4d8b-bc3d-b2dbd9d79c67 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:24:34.380564 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-eb3f52a2-bd91-4d8b-bc3d-b2dbd9d79c67 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:24:34.393300 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.wsgi [None req-eb3f52a2-bd91-4d8b-bc3d-b2dbd9d79c67 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] HTTP exception thrown: Instance 61abeff2-268a-4149-9962-497c409663ed could not be found. Mar 31 18:24:34.393876 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-eb3f52a2-bd91-4d8b-bc3d-b2dbd9d79c67 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Returning 404 to user: Instance 61abeff2-268a-4149-9962-497c409663ed could not be found. {{(pid=117539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:24:34.394702 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-eb3f52a2-bd91-4d8b-bc3d-b2dbd9d79c67 tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed" status: 404 len: 111 microversion: 2.1 time: 0.026797 Mar 31 18:24:34.395225 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 412/836] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:24:34 2022] GET /compute/v2.1/servers/61abeff2-268a-4149-9962-497c409663ed => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 31 18:24:34.640366 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-966da4b8-e3e0-41ba-b432-389930b437ec tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] Calling method '.version_select at 0x7fa4d42a7af0>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:24:34.709606 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-966da4b8-e3e0-41ba-b432-389930b437ec tempest-TestShelveInstance-80407792 tempest-TestShelveInstance-80407792-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1385990206" status: 202 len: 0 microversion: 2.1 time: 0.074547 Mar 31 18:24:34.710185 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 425/837] 10.222.0.58 () {58 vars in 1253 bytes} [Thu Mar 31 18:24:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1385990206 => generated 0 bytes in 76 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 31 18:24:51.134246 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-88679f16-a51e-4f46-957e-ba5c2b2d1ee4 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:24:51.135145 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-88679f16-a51e-4f46-957e-ba5c2b2d1ee4 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:24:51.141580 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-88679f16-a51e-4f46-957e-ba5c2b2d1ee4 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:24:51.142072 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-88679f16-a51e-4f46-957e-ba5c2b2d1ee4 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:24:51.142887 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-88679f16-a51e-4f46-957e-ba5c2b2d1ee4 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:24:51.143320 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-88679f16-a51e-4f46-957e-ba5c2b2d1ee4 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:24:51.170459 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-88679f16-a51e-4f46-957e-ba5c2b2d1ee4 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.040370 Mar 31 18:24:51.171096 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 413/838] 10.222.0.58 () {60 vars in 1342 bytes} [Thu Mar 31 18:24:51 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f/os-volume_attachments => generated 25 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:24:51.242460 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-c94ccd26-c3eb-459e-a862-6d2c075e10c5 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:24:51.243022 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-c94ccd26-c3eb-459e-a862-6d2c075e10c5 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:24:51.249524 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c94ccd26-c3eb-459e-a862-6d2c075e10c5 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:24:51.250852 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c94ccd26-c3eb-459e-a862-6d2c075e10c5 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:24:51.251619 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c94ccd26-c3eb-459e-a862-6d2c075e10c5 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:24:51.252044 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c94ccd26-c3eb-459e-a862-6d2c075e10c5 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:24:51.275880 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-c94ccd26-c3eb-459e-a862-6d2c075e10c5 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Going to try to terminate instance {{(pid=117538) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 31 18:24:51.695291 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-c94ccd26-c3eb-459e-a862-6d2c075e10c5 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 204 len: 0 microversion: 2.20 time: 0.457103 Mar 31 18:24:51.695892 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 426/839] 10.222.0.58 () {60 vars in 1279 bytes} [Thu Mar 31 18:24:51 2022] DELETE /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 0 bytes in 459 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Mar 31 18:24:51.704407 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-27d3338a-3bdc-4c9e-b5ef-dc4534ab88e6 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:24:51.705020 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-27d3338a-3bdc-4c9e-b5ef-dc4534ab88e6 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:24:51.711078 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-27d3338a-3bdc-4c9e-b5ef-dc4534ab88e6 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:24:51.711526 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-27d3338a-3bdc-4c9e-b5ef-dc4534ab88e6 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:24:51.712288 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-27d3338a-3bdc-4c9e-b5ef-dc4534ab88e6 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:24:51.712716 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-27d3338a-3bdc-4c9e-b5ef-dc4534ab88e6 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:24:51.852357 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-27d3338a-3bdc-4c9e-b5ef-dc4534ab88e6 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:24:51.860964 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-27d3338a-3bdc-4c9e-b5ef-dc4534ab88e6 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:24:51.862452 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-27d3338a-3bdc-4c9e-b5ef-dc4534ab88e6 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:24:51.863639 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-27d3338a-3bdc-4c9e-b5ef-dc4534ab88e6 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1723 microversion: 2.20 time: 0.163279 Mar 31 18:24:51.864204 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 414/840] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:24:51 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:24:52.883021 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-967b2942-a2f3-48d8-bb3f-946f61dc359f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:24:52.883740 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-967b2942-a2f3-48d8-bb3f-946f61dc359f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:24:52.891388 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-967b2942-a2f3-48d8-bb3f-946f61dc359f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:24:52.892070 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-967b2942-a2f3-48d8-bb3f-946f61dc359f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:24:52.892856 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-967b2942-a2f3-48d8-bb3f-946f61dc359f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:24:52.893297 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-967b2942-a2f3-48d8-bb3f-946f61dc359f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:24:53.034569 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-967b2942-a2f3-48d8-bb3f-946f61dc359f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:24:53.042510 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-967b2942-a2f3-48d8-bb3f-946f61dc359f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:24:53.044071 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-967b2942-a2f3-48d8-bb3f-946f61dc359f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:24:53.045229 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-967b2942-a2f3-48d8-bb3f-946f61dc359f tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1723 microversion: 2.20 time: 0.166679 Mar 31 18:24:53.045785 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 427/841] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:24:52 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1723 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Mar 31 18:24:54.065618 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-77a56020-7d85-4155-bb22-c60f4d05cafb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:24:54.066557 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-77a56020-7d85-4155-bb22-c60f4d05cafb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:24:54.073456 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-77a56020-7d85-4155-bb22-c60f4d05cafb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:24:54.073902 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-77a56020-7d85-4155-bb22-c60f4d05cafb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:24:54.074715 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-77a56020-7d85-4155-bb22-c60f4d05cafb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:24:54.075148 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-77a56020-7d85-4155-bb22-c60f4d05cafb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:24:54.215382 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-77a56020-7d85-4155-bb22-c60f4d05cafb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:24:54.223620 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-77a56020-7d85-4155-bb22-c60f4d05cafb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:24:54.225097 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-77a56020-7d85-4155-bb22-c60f4d05cafb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:24:54.226236 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-77a56020-7d85-4155-bb22-c60f4d05cafb tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1723 microversion: 2.20 time: 0.166014 Mar 31 18:24:54.226822 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 415/842] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:24:54 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1723 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 31 18:24:54.811473 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [req-578d5842-f848-4086-a9c9-482485382b8f req-287adb6b-9f97-415d-a217-7c34871b5eeb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e404c053-bc21-4cf0-9ba6-07e6971e588f", "name": "network-vif-deleted", "tag": "af48c6cc-61d7-40f4-85b0-60adf2267642"}]} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:24:54.820987 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-578d5842-f848-4086-a9c9-482485382b8f req-287adb6b-9f97-415d-a217-7c34871b5eeb service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:24:54.821772 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-578d5842-f848-4086-a9c9-482485382b8f req-287adb6b-9f97-415d-a217-7c34871b5eeb service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:24:54.834288 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.compute.server_external_events [req-578d5842-f848-4086-a9c9-482485382b8f req-287adb6b-9f97-415d-a217-7c34871b5eeb service nova] Creating event network-vif-deleted:af48c6cc-61d7-40f4-85b0-60adf2267642 for instance e404c053-bc21-4cf0-9ba6-07e6971e588f on hv-cinder-maste Mar 31 18:24:54.842634 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [req-578d5842-f848-4086-a9c9-482485382b8f req-287adb6b-9f97-415d-a217-7c34871b5eeb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034862 Mar 31 18:24:54.844285 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 428/843] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:24:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:24:55.245601 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-d04d620b-4708-42e6-8f42-e5f84abcb536 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:24:55.246255 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-d04d620b-4708-42e6-8f42-e5f84abcb536 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:24:55.253046 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-d04d620b-4708-42e6-8f42-e5f84abcb536 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:24:55.253554 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-d04d620b-4708-42e6-8f42-e5f84abcb536 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:24:55.254332 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-d04d620b-4708-42e6-8f42-e5f84abcb536 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:24:55.254790 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-d04d620b-4708-42e6-8f42-e5f84abcb536 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:24:55.287904 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-d04d620b-4708-42e6-8f42-e5f84abcb536 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:24:55.288265 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-d04d620b-4708-42e6-8f42-e5f84abcb536 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:24:55.288765 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.objects.instance [None req-d04d620b-4708-42e6-8f42-e5f84abcb536 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lazy-loading 'fault' on Instance uuid e404c053-bc21-4cf0-9ba6-07e6971e588f {{(pid=117539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 31 18:24:55.341554 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-d04d620b-4708-42e6-8f42-e5f84abcb536 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:24:55.341961 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-d04d620b-4708-42e6-8f42-e5f84abcb536 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:24:55.344285 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-d04d620b-4708-42e6-8f42-e5f84abcb536 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'b1092332ac6040c597d28a4207c1ce86', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eb7248f2c93342cd823f385c53a69d05', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:24:55.345513 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-d04d620b-4708-42e6-8f42-e5f84abcb536 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 200 len: 1371 microversion: 2.20 time: 0.104097 Mar 31 18:24:55.346116 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 416/844] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:24:55 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 1371 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Mar 31 18:24:56.364862 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-1ca4d60e-e617-4bc7-8656-1d6226fd3fe2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:24:56.365549 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-1ca4d60e-e617-4bc7-8656-1d6226fd3fe2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:24:56.372138 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-1ca4d60e-e617-4bc7-8656-1d6226fd3fe2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:24:56.372584 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-1ca4d60e-e617-4bc7-8656-1d6226fd3fe2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:24:56.373336 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-1ca4d60e-e617-4bc7-8656-1d6226fd3fe2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:24:56.373760 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-1ca4d60e-e617-4bc7-8656-1d6226fd3fe2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:24:56.387627 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.wsgi [None req-1ca4d60e-e617-4bc7-8656-1d6226fd3fe2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] HTTP exception thrown: Instance e404c053-bc21-4cf0-9ba6-07e6971e588f could not be found. Mar 31 18:24:56.388213 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-1ca4d60e-e617-4bc7-8656-1d6226fd3fe2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Returning 404 to user: Instance e404c053-bc21-4cf0-9ba6-07e6971e588f could not be found. {{(pid=117538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:24:56.389317 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-1ca4d60e-e617-4bc7-8656-1d6226fd3fe2 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 404 len: 111 microversion: 2.20 time: 0.028483 Mar 31 18:24:56.389869 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 429/845] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:24:56 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 31 18:24:56.399100 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-3de827ec-c194-4f88-8b5b-acc0ba466693 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '.version_select at 0x7fa4d4272310>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:24:56.402146 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: ERROR oslo.messaging._drivers.impl_rabbit [None req-3de827ec-c194-4f88-8b5b-acc0ba466693 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [bfbc03ca-cc3e-4a76-90b3-c7d6c188a7c6] AMQP server on 10.222.0.58:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Mar 31 18:24:57.411830 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO oslo.messaging._drivers.impl_rabbit [None req-3de827ec-c194-4f88-8b5b-acc0ba466693 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [bfbc03ca-cc3e-4a76-90b3-c7d6c188a7c6] Reconnected to AMQP server on 10.222.0.58:5672 via [amqp] client with port 60604. Mar 31 18:24:57.536483 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-3de827ec-c194-4f88-8b5b-acc0ba466693 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1729630098" status: 204 len: 0 microversion: 2.20 time: 1.141248 Mar 31 18:24:57.537075 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 417/846] 10.222.0.58 () {60 vars in 1261 bytes} [Thu Mar 31 18:24:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1729630098 => generated 0 bytes in 1143 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Mar 31 18:24:59.667603 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-24349cf1-dc90-45b0-ac4f-a34df5023e9a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:24:59.668116 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-24349cf1-dc90-45b0-ac4f-a34df5023e9a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:24:59.674446 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-24349cf1-dc90-45b0-ac4f-a34df5023e9a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:24:59.674928 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-24349cf1-dc90-45b0-ac4f-a34df5023e9a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:24:59.675692 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-24349cf1-dc90-45b0-ac4f-a34df5023e9a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:24:59.676122 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-24349cf1-dc90-45b0-ac4f-a34df5023e9a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:24:59.689954 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.wsgi [None req-24349cf1-dc90-45b0-ac4f-a34df5023e9a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] HTTP exception thrown: Instance e404c053-bc21-4cf0-9ba6-07e6971e588f could not be found. Mar 31 18:24:59.690539 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-24349cf1-dc90-45b0-ac4f-a34df5023e9a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Returning 404 to user: Instance e404c053-bc21-4cf0-9ba6-07e6971e588f could not be found. {{(pid=117538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:24:59.691391 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-24349cf1-dc90-45b0-ac4f-a34df5023e9a tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "DELETE /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 404 len: 111 microversion: 2.20 time: 0.027713 Mar 31 18:24:59.691932 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 430/847] 10.222.0.58 () {60 vars in 1279 bytes} [Thu Mar 31 18:24:59 2022] DELETE /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 31 18:24:59.700021 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-7d380687-a823-43ac-a496-2542847e6cb6 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:24:59.700663 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-7d380687-a823-43ac-a496-2542847e6cb6 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: e404c053-bc21-4cf0-9ba6-07e6971e588f] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:24:59.707989 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-7d380687-a823-43ac-a496-2542847e6cb6 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:24:59.708432 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-7d380687-a823-43ac-a496-2542847e6cb6 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:24:59.709192 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-7d380687-a823-43ac-a496-2542847e6cb6 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:24:59.709620 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-7d380687-a823-43ac-a496-2542847e6cb6 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:24:59.722246 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.wsgi [None req-7d380687-a823-43ac-a496-2542847e6cb6 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] HTTP exception thrown: Instance e404c053-bc21-4cf0-9ba6-07e6971e588f could not be found. Mar 31 18:24:59.722860 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-7d380687-a823-43ac-a496-2542847e6cb6 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Returning 404 to user: Instance e404c053-bc21-4cf0-9ba6-07e6971e588f could not be found. {{(pid=117539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:24:59.723701 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-7d380687-a823-43ac-a496-2542847e6cb6 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f" status: 404 len: 111 microversion: 2.20 time: 0.027573 Mar 31 18:24:59.724254 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 418/848] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:24:59 2022] GET /compute/v2.1/servers/e404c053-bc21-4cf0-9ba6-07e6971e588f => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Mar 31 18:25:00.970404 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-20a40eaf-597f-4115-96d3-4821fd0a33bc tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:25:00.970960 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-20a40eaf-597f-4115-96d3-4821fd0a33bc tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:25:00.977296 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-20a40eaf-597f-4115-96d3-4821fd0a33bc tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:00.977744 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-20a40eaf-597f-4115-96d3-4821fd0a33bc tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:00.978512 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-20a40eaf-597f-4115-96d3-4821fd0a33bc tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:00.978972 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-20a40eaf-597f-4115-96d3-4821fd0a33bc tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:00.992209 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.wsgi [None req-20a40eaf-597f-4115-96d3-4821fd0a33bc tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] HTTP exception thrown: Instance 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 could not be found. Mar 31 18:25:00.992801 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-20a40eaf-597f-4115-96d3-4821fd0a33bc tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Returning 404 to user: Instance 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 could not be found. {{(pid=117538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:25:00.993617 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-20a40eaf-597f-4115-96d3-4821fd0a33bc tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 404 len: 111 microversion: 2.20 time: 0.028129 Mar 31 18:25:00.994171 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 431/849] 10.222.0.58 () {60 vars in 1279 bytes} [Thu Mar 31 18:25:00 2022] DELETE /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 31 18:25:01.002628 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-6e068b66-79ab-40cd-bbd8-dac401095c76 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:25:01.003239 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-6e068b66-79ab-40cd-bbd8-dac401095c76 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] [instance: 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:25:01.008986 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-6e068b66-79ab-40cd-bbd8-dac401095c76 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:01.009420 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-6e068b66-79ab-40cd-bbd8-dac401095c76 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:01.010166 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-6e068b66-79ab-40cd-bbd8-dac401095c76 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:01.010635 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-6e068b66-79ab-40cd-bbd8-dac401095c76 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:01.024541 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.wsgi [None req-6e068b66-79ab-40cd-bbd8-dac401095c76 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] HTTP exception thrown: Instance 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 could not be found. Mar 31 18:25:01.025113 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-6e068b66-79ab-40cd-bbd8-dac401095c76 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] Returning 404 to user: Instance 8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 could not be found. {{(pid=117539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:25:01.025920 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-6e068b66-79ab-40cd-bbd8-dac401095c76 tempest-AttachVolumeShelveTestJSON-1315462602 tempest-AttachVolumeShelveTestJSON-1315462602-project] 10.222.0.58 "GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0" status: 404 len: 111 microversion: 2.20 time: 0.027685 Mar 31 18:25:01.026443 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 419/850] 10.222.0.58 () {60 vars in 1276 bytes} [Thu Mar 31 18:25:00 2022] GET /compute/v2.1/servers/8ca1ed62-e3c8-41c5-b22d-87773bb2e1c0 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Mar 31 18:25:04.652842 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-a4ee6698-fcc0-4073-a5ec-2c52ae30926f tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:25:04.653994 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-a4ee6698-fcc0-4073-a5ec-2c52ae30926f tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:25:04.663471 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a4ee6698-fcc0-4073-a5ec-2c52ae30926f tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:04.664195 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a4ee6698-fcc0-4073-a5ec-2c52ae30926f tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:04.665481 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a4ee6698-fcc0-4073-a5ec-2c52ae30926f tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:04.666076 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a4ee6698-fcc0-4073-a5ec-2c52ae30926f tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:04.776245 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.objects.instance [None req-a4ee6698-fcc0-4073-a5ec-2c52ae30926f tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lazy-loading 'services' on Instance uuid 01ac6bc8-6406-46d8-b8a1-628449e68e58 {{(pid=117538) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 31 18:25:05.007334 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-a4ee6698-fcc0-4073-a5ec-2c52ae30926f tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "DELETE /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58/os-volume_attachments/83ec71a7-25e5-4585-904f-ade2d0e58dd9" status: 202 len: 0 microversion: 2.1 time: 0.360301 Mar 31 18:25:05.008102 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 432/851] 10.222.0.58 () {58 vars in 1415 bytes} [Thu Mar 31 18:25:04 2022] DELETE /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58/os-volume_attachments/83ec71a7-25e5-4585-904f-ade2d0e58dd9 => generated 0 bytes in 362 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 31 18:25:06.188008 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-98016cf9-ffcc-4ac9-ac8c-55fad9c45600 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:25:06.188885 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-98016cf9-ffcc-4ac9-ac8c-55fad9c45600 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:06.189402 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-98016cf9-ffcc-4ac9-ac8c-55fad9c45600 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:06.213625 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-98016cf9-ffcc-4ac9-ac8c-55fad9c45600 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Going to try to stop instance {{(pid=117539) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Mar 31 18:25:06.439292 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-98016cf9-ffcc-4ac9-ac8c-55fad9c45600 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "POST /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58/action" status: 202 len: 0 microversion: 2.1 time: 0.269636 Mar 31 18:25:06.440308 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 420/852] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Mar 31 18:25:06 2022] POST /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58/action => generated 0 bytes in 272 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 31 18:25:06.451744 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-46d045a8-d620-4d42-bd77-900dd1ae0248 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:25:06.451744 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-46d045a8-d620-4d42-bd77-900dd1ae0248 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:25:06.458522 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-46d045a8-d620-4d42-bd77-900dd1ae0248 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:06.459879 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-46d045a8-d620-4d42-bd77-900dd1ae0248 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:06.459879 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-46d045a8-d620-4d42-bd77-900dd1ae0248 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:06.460165 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-46d045a8-d620-4d42-bd77-900dd1ae0248 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:06.641510 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-46d045a8-d620-4d42-bd77-900dd1ae0248 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:25:06.650001 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-46d045a8-d620-4d42-bd77-900dd1ae0248 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58" status: 200 len: 1678 microversion: 2.1 time: 0.204322 Mar 31 18:25:06.651463 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 433/853] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:25:06 2022] GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58 => generated 1678 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:25:07.672443 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-2eeb13ec-f84e-464c-836d-7330a7d3fcd2 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:25:07.673167 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-2eeb13ec-f84e-464c-836d-7330a7d3fcd2 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:25:07.679409 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-2eeb13ec-f84e-464c-836d-7330a7d3fcd2 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:07.679849 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-2eeb13ec-f84e-464c-836d-7330a7d3fcd2 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:07.680656 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-2eeb13ec-f84e-464c-836d-7330a7d3fcd2 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:07.681072 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-2eeb13ec-f84e-464c-836d-7330a7d3fcd2 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:07.831819 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-2eeb13ec-f84e-464c-836d-7330a7d3fcd2 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:25:07.839765 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-2eeb13ec-f84e-464c-836d-7330a7d3fcd2 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58" status: 200 len: 1678 microversion: 2.1 time: 0.171878 Mar 31 18:25:07.840341 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 421/854] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:25:07 2022] GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58 => generated 1678 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:25:08.858762 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-9f070f19-6833-4e1c-ada3-0f1f20cdd59c tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:25:08.860086 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-9f070f19-6833-4e1c-ada3-0f1f20cdd59c tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:25:08.866189 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9f070f19-6833-4e1c-ada3-0f1f20cdd59c tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:08.866667 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9f070f19-6833-4e1c-ada3-0f1f20cdd59c tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:08.867494 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9f070f19-6833-4e1c-ada3-0f1f20cdd59c tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:08.867935 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9f070f19-6833-4e1c-ada3-0f1f20cdd59c tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:09.107187 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-9f070f19-6833-4e1c-ada3-0f1f20cdd59c tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:25:09.115710 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-9f070f19-6833-4e1c-ada3-0f1f20cdd59c tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58" status: 200 len: 1678 microversion: 2.1 time: 0.261198 Mar 31 18:25:09.116322 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 434/855] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:25:08 2022] GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58 => generated 1678 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:25:10.135229 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-95af7aee-29f0-4e16-8cd9-c5cb23fca519 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:25:10.135229 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-95af7aee-29f0-4e16-8cd9-c5cb23fca519 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:25:10.143085 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-95af7aee-29f0-4e16-8cd9-c5cb23fca519 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:10.143753 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-95af7aee-29f0-4e16-8cd9-c5cb23fca519 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:10.144944 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-95af7aee-29f0-4e16-8cd9-c5cb23fca519 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:10.145546 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-95af7aee-29f0-4e16-8cd9-c5cb23fca519 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:10.352538 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-95af7aee-29f0-4e16-8cd9-c5cb23fca519 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:25:10.368290 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-95af7aee-29f0-4e16-8cd9-c5cb23fca519 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58" status: 200 len: 1678 microversion: 2.1 time: 0.237854 Mar 31 18:25:10.369339 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 422/856] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:25:10 2022] GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58 => generated 1678 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:25:11.386652 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-703c71d8-d824-43cf-b74f-a3c70fdfdd5b tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:25:11.387254 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-703c71d8-d824-43cf-b74f-a3c70fdfdd5b tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:25:11.394633 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-703c71d8-d824-43cf-b74f-a3c70fdfdd5b tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:11.395088 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-703c71d8-d824-43cf-b74f-a3c70fdfdd5b tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:11.395855 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-703c71d8-d824-43cf-b74f-a3c70fdfdd5b tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:11.396282 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-703c71d8-d824-43cf-b74f-a3c70fdfdd5b tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:11.657881 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-703c71d8-d824-43cf-b74f-a3c70fdfdd5b tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:25:11.671860 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-703c71d8-d824-43cf-b74f-a3c70fdfdd5b tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58" status: 200 len: 1678 microversion: 2.1 time: 0.288498 Mar 31 18:25:11.673220 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 435/857] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:25:11 2022] GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58 => generated 1678 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:25:12.695847 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-84170e56-a1c3-48f2-8cbb-5445003193f3 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:25:12.696385 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-84170e56-a1c3-48f2-8cbb-5445003193f3 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:25:12.704740 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-84170e56-a1c3-48f2-8cbb-5445003193f3 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:12.705190 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-84170e56-a1c3-48f2-8cbb-5445003193f3 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:12.705970 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-84170e56-a1c3-48f2-8cbb-5445003193f3 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:12.706402 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-84170e56-a1c3-48f2-8cbb-5445003193f3 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:12.936137 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-84170e56-a1c3-48f2-8cbb-5445003193f3 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:25:12.950266 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-84170e56-a1c3-48f2-8cbb-5445003193f3 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58" status: 200 len: 1678 microversion: 2.1 time: 0.263109 Mar 31 18:25:12.951147 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 423/858] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:25:12 2022] GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58 => generated 1678 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:25:13.471002 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-a60b0662-ff9d-490e-a7be-d7242b7bf6ba tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Action: 'create', calling method: .version_select at 0x7fa4d4388430>, body: {"keypair": {"name": "tempest-keypair-185317611"}} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:25:13.486569 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.quota [None req-a60b0662-ff9d-490e-a7be-d7242b7bf6ba tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Getting quotas for project 7ae2325a87da4c5f8179a77fbd3d8748. Resources: {'key_pairs'} {{(pid=117538) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 31 18:25:13.492093 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.quota [None req-a60b0662-ff9d-490e-a7be-d7242b7bf6ba tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Getting quotas for user 211572ee7ab5422981422eaed6341657 and project 7ae2325a87da4c5f8179a77fbd3d8748. Resources: {'key_pairs'} {{(pid=117538) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 31 18:25:13.919004 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.quota [None req-a60b0662-ff9d-490e-a7be-d7242b7bf6ba tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Getting quotas for project 7ae2325a87da4c5f8179a77fbd3d8748. Resources: {'key_pairs'} {{(pid=117538) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 31 18:25:13.923573 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.quota [None req-a60b0662-ff9d-490e-a7be-d7242b7bf6ba tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Getting quotas for user 211572ee7ab5422981422eaed6341657 and project 7ae2325a87da4c5f8179a77fbd3d8748. Resources: {'key_pairs'} {{(pid=117538) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 31 18:25:13.936473 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-a60b0662-ff9d-490e-a7be-d7242b7bf6ba tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 2300 microversion: 2.1 time: 0.596806 Mar 31 18:25:13.937369 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 436/859] 10.222.0.58 () {60 vars in 1157 bytes} [Thu Mar 31 18:25:13 2022] POST /compute/v2.1/os-keypairs => generated 2300 bytes in 598 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:25:13.970468 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-9ee96533-acd2-49eb-b3b7-9615a9c2c446 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:25:13.971379 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-9ee96533-acd2-49eb-b3b7-9615a9c2c446 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:25:13.977481 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9ee96533-acd2-49eb-b3b7-9615a9c2c446 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:13.980205 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9ee96533-acd2-49eb-b3b7-9615a9c2c446 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:13.980205 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9ee96533-acd2-49eb-b3b7-9615a9c2c446 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:13.980205 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9ee96533-acd2-49eb-b3b7-9615a9c2c446 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:14.181890 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-9ee96533-acd2-49eb-b3b7-9615a9c2c446 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:25:14.192443 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-9ee96533-acd2-49eb-b3b7-9615a9c2c446 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58" status: 200 len: 1678 microversion: 2.1 time: 0.226779 Mar 31 18:25:14.193843 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 424/860] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:25:13 2022] GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58 => generated 1678 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:25:15.210971 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-ab99921c-224a-4cd4-b077-1c66f9041d19 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:25:15.211580 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-ab99921c-224a-4cd4-b077-1c66f9041d19 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:25:15.219044 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-ab99921c-224a-4cd4-b077-1c66f9041d19 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:15.225340 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-ab99921c-224a-4cd4-b077-1c66f9041d19 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:15.225340 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-ab99921c-224a-4cd4-b077-1c66f9041d19 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:15.225340 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-ab99921c-224a-4cd4-b077-1c66f9041d19 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:15.411405 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-ab99921c-224a-4cd4-b077-1c66f9041d19 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:25:15.423050 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-ab99921c-224a-4cd4-b077-1c66f9041d19 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58" status: 200 len: 1678 microversion: 2.1 time: 0.216073 Mar 31 18:25:15.426474 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 437/861] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:25:15 2022] GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58 => generated 1678 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:25:16.448548 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-cabb020e-24a2-4bca-970d-eb9c74980302 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:25:16.449320 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-cabb020e-24a2-4bca-970d-eb9c74980302 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:25:16.456701 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-cabb020e-24a2-4bca-970d-eb9c74980302 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:16.457151 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-cabb020e-24a2-4bca-970d-eb9c74980302 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:16.457933 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-cabb020e-24a2-4bca-970d-eb9c74980302 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:16.458363 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-cabb020e-24a2-4bca-970d-eb9c74980302 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:16.694998 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-cabb020e-24a2-4bca-970d-eb9c74980302 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:25:16.714995 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-cabb020e-24a2-4bca-970d-eb9c74980302 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58" status: 200 len: 1678 microversion: 2.1 time: 0.269946 Mar 31 18:25:16.716096 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 425/862] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:25:16 2022] GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58 => generated 1678 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:25:16.803478 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-b3990286-8a42-4574-9c6c-be39e1544310 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1108374147", "imageRef": "6241b999-6f6d-4076-88bc-345fa7386256", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "48b6e4a0-767f-4f89-81e1-af0f127e9429"}], "security_groups": [{"name": "tempest-securitygroup--1896656547"}], "key_name": "tempest-keypair-185317611", "user_data": "}} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:25:16.937033 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.network.neutron [None req-b3990286-8a42-4574-9c6c-be39e1544310 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] validate_networks() for [('48b6e4a0-767f-4f89-81e1-af0f127e9429', None, None, None, None, None)] {{(pid=117538) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 31 18:25:17.399020 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.virt.hardware [None req-b3990286-8a42-4574-9c6c-be39e1544310 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Flavor limits 0:0:0 {{(pid=117538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 31 18:25:17.399956 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.virt.hardware [None req-b3990286-8a42-4574-9c6c-be39e1544310 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Image limits 0:0:0 {{(pid=117538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 31 18:25:17.400740 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.virt.hardware [None req-b3990286-8a42-4574-9c6c-be39e1544310 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Flavor pref 0:0:0 {{(pid=117538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 31 18:25:17.401368 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.virt.hardware [None req-b3990286-8a42-4574-9c6c-be39e1544310 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Image pref 0:0:0 {{(pid=117538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 31 18:25:17.402040 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.virt.hardware [None req-b3990286-8a42-4574-9c6c-be39e1544310 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 31 18:25:17.415870 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b3990286-8a42-4574-9c6c-be39e1544310 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:17.418327 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b3990286-8a42-4574-9c6c-be39e1544310 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:17.419268 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b3990286-8a42-4574-9c6c-be39e1544310 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:17.419708 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b3990286-8a42-4574-9c6c-be39e1544310 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:17.445226 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.quota [None req-b3990286-8a42-4574-9c6c-be39e1544310 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Getting quotas for project 7ae2325a87da4c5f8179a77fbd3d8748. Resources: {'instances', 'ram', 'cores'} {{(pid=117538) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 31 18:25:17.449757 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.quota [None req-b3990286-8a42-4574-9c6c-be39e1544310 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Getting quotas for user 211572ee7ab5422981422eaed6341657 and project 7ae2325a87da4c5f8179a77fbd3d8748. Resources: {'instances', 'ram', 'cores'} {{(pid=117538) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 31 18:25:17.463765 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-b3990286-8a42-4574-9c6c-be39e1544310 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Going to run 1 instances... {{(pid=117538) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 31 18:25:17.466767 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-b3990286-8a42-4574-9c6c-be39e1544310 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 8d43f77a-cb85-4276-9bed-686f306ea21a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6241b999-6f6d-4076-88bc-345fa7386256',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117538) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 31 18:25:17.625061 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-b3990286-8a42-4574-9c6c-be39e1544310 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.825876 Mar 31 18:25:17.625935 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 438/863] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Mar 31 18:25:16 2022] POST /compute/v2.1/servers => generated 402 bytes in 827 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 31 18:25:17.637969 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-96ca3d7f-9279-4321-9172-b86075759f33 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:25:17.638795 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-96ca3d7f-9279-4321-9172-b86075759f33 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 8d43f77a-cb85-4276-9bed-686f306ea21a] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:25:17.694235 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-96ca3d7f-9279-4321-9172-b86075759f33 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:25:17.701444 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-96ca3d7f-9279-4321-9172-b86075759f33 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a" status: 200 len: 1241 microversion: 2.1 time: 0.067283 Mar 31 18:25:17.702128 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 426/864] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:25:17 2022] GET /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:25:17.737485 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-2f20b33a-245e-44d4-88c4-49a919b898c5 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:25:17.738419 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-2f20b33a-245e-44d4-88c4-49a919b898c5 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:25:17.750899 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-2f20b33a-245e-44d4-88c4-49a919b898c5 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:17.751240 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-2f20b33a-245e-44d4-88c4-49a919b898c5 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:17.752451 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-2f20b33a-245e-44d4-88c4-49a919b898c5 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:17.753122 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-2f20b33a-245e-44d4-88c4-49a919b898c5 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:17.909010 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-2f20b33a-245e-44d4-88c4-49a919b898c5 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:25:17.916694 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-2f20b33a-245e-44d4-88c4-49a919b898c5 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58" status: 200 len: 1678 microversion: 2.1 time: 0.186186 Mar 31 18:25:17.917272 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 439/865] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:25:17 2022] GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58 => generated 1678 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:25:18.720266 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-6cddfc31-c8c7-4243-9b27-45d29618d328 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:25:18.721070 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-6cddfc31-c8c7-4243-9b27-45d29618d328 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 8d43f77a-cb85-4276-9bed-686f306ea21a] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:25:18.782566 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-6cddfc31-c8c7-4243-9b27-45d29618d328 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:25:18.790341 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-6cddfc31-c8c7-4243-9b27-45d29618d328 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a" status: 200 len: 1241 microversion: 2.1 time: 0.075041 Mar 31 18:25:18.791110 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 427/866] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:25:18 2022] GET /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a => generated 1241 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:25:18.933883 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-73457d36-d759-411f-81e0-16c59fe23774 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:25:18.934432 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-73457d36-d759-411f-81e0-16c59fe23774 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:25:18.941812 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-73457d36-d759-411f-81e0-16c59fe23774 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:18.942257 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-73457d36-d759-411f-81e0-16c59fe23774 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:18.943042 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-73457d36-d759-411f-81e0-16c59fe23774 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:18.943467 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-73457d36-d759-411f-81e0-16c59fe23774 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:19.084652 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-73457d36-d759-411f-81e0-16c59fe23774 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:25:19.092479 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-73457d36-d759-411f-81e0-16c59fe23774 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58" status: 200 len: 1678 microversion: 2.1 time: 0.162529 Mar 31 18:25:19.093047 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 440/867] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:25:18 2022] GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58 => generated 1678 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:25:19.807653 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-e96ea993-efa2-4c3a-9a35-835d293726be tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:25:19.808307 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-e96ea993-efa2-4c3a-9a35-835d293726be tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 8d43f77a-cb85-4276-9bed-686f306ea21a] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:25:19.862079 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-e96ea993-efa2-4c3a-9a35-835d293726be tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:25:19.869006 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-e96ea993-efa2-4c3a-9a35-835d293726be tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a" status: 200 len: 1241 microversion: 2.1 time: 0.065313 Mar 31 18:25:19.869668 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 428/868] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:25:19 2022] GET /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a => generated 1241 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:25:20.109846 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-03dff5f5-2b14-4451-ba3e-2fe7b852b5f2 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:25:20.110479 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-03dff5f5-2b14-4451-ba3e-2fe7b852b5f2 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:25:20.116852 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-03dff5f5-2b14-4451-ba3e-2fe7b852b5f2 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:20.117296 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-03dff5f5-2b14-4451-ba3e-2fe7b852b5f2 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:20.118049 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-03dff5f5-2b14-4451-ba3e-2fe7b852b5f2 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:20.118490 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-03dff5f5-2b14-4451-ba3e-2fe7b852b5f2 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:20.263807 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-03dff5f5-2b14-4451-ba3e-2fe7b852b5f2 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:25:20.273265 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-03dff5f5-2b14-4451-ba3e-2fe7b852b5f2 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58" status: 200 len: 1678 microversion: 2.1 time: 0.167582 Mar 31 18:25:20.273841 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 441/869] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:25:20 2022] GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58 => generated 1678 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:25:20.889400 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-767df33f-3e1c-4ee7-b829-9e0b18ee16f1 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:25:20.890936 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-767df33f-3e1c-4ee7-b829-9e0b18ee16f1 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 8d43f77a-cb85-4276-9bed-686f306ea21a] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:25:20.942952 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-767df33f-3e1c-4ee7-b829-9e0b18ee16f1 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:25:20.949864 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-767df33f-3e1c-4ee7-b829-9e0b18ee16f1 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a" status: 200 len: 1241 microversion: 2.1 time: 0.064631 Mar 31 18:25:20.950416 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 429/870] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:25:20 2022] GET /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a => generated 1241 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:25:21.290737 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-93b39f93-30a9-4563-a4b6-9d21ca79e087 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:25:21.291497 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-93b39f93-30a9-4563-a4b6-9d21ca79e087 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:25:21.299121 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-93b39f93-30a9-4563-a4b6-9d21ca79e087 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:21.299569 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-93b39f93-30a9-4563-a4b6-9d21ca79e087 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:21.300337 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-93b39f93-30a9-4563-a4b6-9d21ca79e087 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:21.300771 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-93b39f93-30a9-4563-a4b6-9d21ca79e087 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:21.440556 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-93b39f93-30a9-4563-a4b6-9d21ca79e087 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:25:21.447948 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-93b39f93-30a9-4563-a4b6-9d21ca79e087 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58" status: 200 len: 1678 microversion: 2.1 time: 0.161237 Mar 31 18:25:21.448512 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 442/871] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:25:21 2022] GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58 => generated 1678 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:25:21.967060 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-29809e98-35f4-4de4-b30d-a7b4c78a08e8 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:25:21.967764 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-29809e98-35f4-4de4-b30d-a7b4c78a08e8 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 8d43f77a-cb85-4276-9bed-686f306ea21a] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:25:21.974379 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-29809e98-35f4-4de4-b30d-a7b4c78a08e8 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:21.974850 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-29809e98-35f4-4de4-b30d-a7b4c78a08e8 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:21.975622 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-29809e98-35f4-4de4-b30d-a7b4c78a08e8 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:21.976052 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-29809e98-35f4-4de4-b30d-a7b4c78a08e8 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:22.036292 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-29809e98-35f4-4de4-b30d-a7b4c78a08e8 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:25:22.043656 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-29809e98-35f4-4de4-b30d-a7b4c78a08e8 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a" status: 200 len: 1245 microversion: 2.1 time: 0.080391 Mar 31 18:25:22.044235 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 430/872] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:25:21 2022] GET /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a => generated 1245 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:25:22.471630 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-5348af55-1bba-4201-8db7-fc39fdf79006 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:25:22.472217 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-5348af55-1bba-4201-8db7-fc39fdf79006 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:25:22.478575 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-5348af55-1bba-4201-8db7-fc39fdf79006 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:22.479046 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-5348af55-1bba-4201-8db7-fc39fdf79006 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:22.479841 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-5348af55-1bba-4201-8db7-fc39fdf79006 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:22.480413 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-5348af55-1bba-4201-8db7-fc39fdf79006 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:22.624991 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-5348af55-1bba-4201-8db7-fc39fdf79006 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:25:22.632787 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-5348af55-1bba-4201-8db7-fc39fdf79006 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58" status: 200 len: 1678 microversion: 2.1 time: 0.165783 Mar 31 18:25:22.633353 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 443/873] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:25:22 2022] GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58 => generated 1678 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:25:23.061409 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-af311a3b-ba78-48b3-9470-3eeede7a4073 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:25:23.063486 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-af311a3b-ba78-48b3-9470-3eeede7a4073 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 8d43f77a-cb85-4276-9bed-686f306ea21a] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:25:23.070413 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-af311a3b-ba78-48b3-9470-3eeede7a4073 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:23.071246 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-af311a3b-ba78-48b3-9470-3eeede7a4073 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:23.071660 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-af311a3b-ba78-48b3-9470-3eeede7a4073 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:23.072081 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-af311a3b-ba78-48b3-9470-3eeede7a4073 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:23.132068 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-af311a3b-ba78-48b3-9470-3eeede7a4073 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:25:23.139708 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-af311a3b-ba78-48b3-9470-3eeede7a4073 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a" status: 200 len: 1245 microversion: 2.1 time: 0.082114 Mar 31 18:25:23.140713 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 431/874] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:25:23 2022] GET /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:25:23.651219 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-daf317d4-75e6-4cad-8fab-421a5d976764 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:25:23.651827 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-daf317d4-75e6-4cad-8fab-421a5d976764 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:25:23.658972 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-daf317d4-75e6-4cad-8fab-421a5d976764 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:23.659429 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-daf317d4-75e6-4cad-8fab-421a5d976764 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:23.660273 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-daf317d4-75e6-4cad-8fab-421a5d976764 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:23.660638 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-daf317d4-75e6-4cad-8fab-421a5d976764 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:23.813836 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-daf317d4-75e6-4cad-8fab-421a5d976764 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:25:23.821410 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-daf317d4-75e6-4cad-8fab-421a5d976764 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58" status: 200 len: 1655 microversion: 2.1 time: 0.174123 Mar 31 18:25:23.821981 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 444/875] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:25:23 2022] GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58 => generated 1655 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:25:23.838312 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-a6a05e58-4edc-4851-8586-7bdfd84276d5 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:25:23.845699 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a6a05e58-4edc-4851-8586-7bdfd84276d5 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:23.846148 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a6a05e58-4edc-4851-8586-7bdfd84276d5 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:23.869029 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-a6a05e58-4edc-4851-8586-7bdfd84276d5 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Going to try to start instance {{(pid=117539) start /opt/stack/nova/nova/compute/api.py:2730}} Mar 31 18:25:24.043149 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-a6a05e58-4edc-4851-8586-7bdfd84276d5 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "POST /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58/action" status: 202 len: 0 microversion: 2.1 time: 0.208356 Mar 31 18:25:24.043690 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 432/876] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Mar 31 18:25:23 2022] POST /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58/action => generated 0 bytes in 210 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 31 18:25:24.053730 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-a905bd54-b583-4580-983c-26a40bf0f951 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:25:24.054460 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-a905bd54-b583-4580-983c-26a40bf0f951 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:25:24.061079 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a905bd54-b583-4580-983c-26a40bf0f951 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:24.061537 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a905bd54-b583-4580-983c-26a40bf0f951 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:24.063073 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a905bd54-b583-4580-983c-26a40bf0f951 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:24.063732 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a905bd54-b583-4580-983c-26a40bf0f951 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:24.158326 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-9b642550-2629-401a-9dda-f57ad0440c71 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:25:24.159478 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-9b642550-2629-401a-9dda-f57ad0440c71 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 8d43f77a-cb85-4276-9bed-686f306ea21a] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:25:24.168471 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9b642550-2629-401a-9dda-f57ad0440c71 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:24.168923 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9b642550-2629-401a-9dda-f57ad0440c71 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:24.170242 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9b642550-2629-401a-9dda-f57ad0440c71 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:24.170872 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9b642550-2629-401a-9dda-f57ad0440c71 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:24.221107 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-a905bd54-b583-4580-983c-26a40bf0f951 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:25:24.237176 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-9b642550-2629-401a-9dda-f57ad0440c71 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:25:24.238741 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-a905bd54-b583-4580-983c-26a40bf0f951 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58" status: 200 len: 1664 microversion: 2.1 time: 0.188961 Mar 31 18:25:24.239901 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 445/877] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:25:24 2022] GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58 => generated 1664 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:25:24.258371 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-9b642550-2629-401a-9dda-f57ad0440c71 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a" status: 200 len: 1293 microversion: 2.1 time: 0.105540 Mar 31 18:25:24.258988 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 433/878] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:25:24 2022] GET /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a => generated 1293 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:25:25.260942 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-8464883a-133a-4b77-97d8-a2e11593c788 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:25:25.261570 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-8464883a-133a-4b77-97d8-a2e11593c788 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:25:25.269214 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8464883a-133a-4b77-97d8-a2e11593c788 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:25.269667 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8464883a-133a-4b77-97d8-a2e11593c788 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:25.270455 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8464883a-133a-4b77-97d8-a2e11593c788 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:25.270919 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8464883a-133a-4b77-97d8-a2e11593c788 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:25.277097 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-2d3f2995-0fba-48b6-bb59-a96209244f1e tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:25:25.277712 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-2d3f2995-0fba-48b6-bb59-a96209244f1e tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 8d43f77a-cb85-4276-9bed-686f306ea21a] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:25:25.284802 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-2d3f2995-0fba-48b6-bb59-a96209244f1e tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:25.285255 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-2d3f2995-0fba-48b6-bb59-a96209244f1e tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:25.288728 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-2d3f2995-0fba-48b6-bb59-a96209244f1e tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:25.288728 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-2d3f2995-0fba-48b6-bb59-a96209244f1e tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:25.354973 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-2d3f2995-0fba-48b6-bb59-a96209244f1e tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:25:25.363134 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-2d3f2995-0fba-48b6-bb59-a96209244f1e tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a" status: 200 len: 1299 microversion: 2.1 time: 0.090104 Mar 31 18:25:25.363713 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 434/879] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:25:25 2022] GET /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a => generated 1299 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:25:25.496362 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-8464883a-133a-4b77-97d8-a2e11593c788 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:25:25.505409 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-8464883a-133a-4b77-97d8-a2e11593c788 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58" status: 200 len: 1664 microversion: 2.1 time: 0.248322 Mar 31 18:25:25.506147 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 446/880] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:25:25 2022] GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58 => generated 1664 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:25:26.385099 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-25fb0d7d-8111-4ee5-bda1-5efd100c3b2b tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:25:26.385708 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-25fb0d7d-8111-4ee5-bda1-5efd100c3b2b tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 8d43f77a-cb85-4276-9bed-686f306ea21a] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:25:26.392783 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-25fb0d7d-8111-4ee5-bda1-5efd100c3b2b tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:26.393041 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-25fb0d7d-8111-4ee5-bda1-5efd100c3b2b tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:26.393810 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-25fb0d7d-8111-4ee5-bda1-5efd100c3b2b tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:26.394244 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-25fb0d7d-8111-4ee5-bda1-5efd100c3b2b tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:26.469609 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [req-7d0e0941-c23a-41bb-8c41-ac8bdce2af45 req-78ab5f5b-cfb7-4767-9986-1f3671ccc939 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d43f77a-cb85-4276-9bed-686f306ea21a", "tag": "66cb4db2-f182-4e79-945c-41d2828096bb"}]} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:25:26.480588 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-7d0e0941-c23a-41bb-8c41-ac8bdce2af45 req-78ab5f5b-cfb7-4767-9986-1f3671ccc939 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:26.481726 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-7d0e0941-c23a-41bb-8c41-ac8bdce2af45 req-78ab5f5b-cfb7-4767-9986-1f3671ccc939 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:26.508605 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.compute.server_external_events [req-7d0e0941-c23a-41bb-8c41-ac8bdce2af45 req-78ab5f5b-cfb7-4767-9986-1f3671ccc939 service nova] Creating event network-changed:66cb4db2-f182-4e79-945c-41d2828096bb for instance 8d43f77a-cb85-4276-9bed-686f306ea21a on hv-cinder-maste Mar 31 18:25:26.515327 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [req-7d0e0941-c23a-41bb-8c41-ac8bdce2af45 req-78ab5f5b-cfb7-4767-9986-1f3671ccc939 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.052772 Mar 31 18:25:26.516318 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 447/881] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:25:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:25:26.523865 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-16ab7b45-e595-436a-878b-748bb08be4e8 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:25:26.524612 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-16ab7b45-e595-436a-878b-748bb08be4e8 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:25:26.531720 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-16ab7b45-e595-436a-878b-748bb08be4e8 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:26.532307 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-16ab7b45-e595-436a-878b-748bb08be4e8 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:26.533187 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-16ab7b45-e595-436a-878b-748bb08be4e8 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:26.533816 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-16ab7b45-e595-436a-878b-748bb08be4e8 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:26.558191 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-25fb0d7d-8111-4ee5-bda1-5efd100c3b2b tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:25:26.566038 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-25fb0d7d-8111-4ee5-bda1-5efd100c3b2b tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a" status: 200 len: 1367 microversion: 2.1 time: 0.184587 Mar 31 18:25:26.566639 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 435/882] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:25:26 2022] GET /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a => generated 1367 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:25:26.769002 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-16ab7b45-e595-436a-878b-748bb08be4e8 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:25:26.776276 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-16ab7b45-e595-436a-878b-748bb08be4e8 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58" status: 200 len: 1668 microversion: 2.1 time: 0.256824 Mar 31 18:25:26.776851 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 448/883] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:25:26 2022] GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58 => generated 1668 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:25:27.582988 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-152b394d-ae04-4f92-83bb-c59cb4e3ef1e tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:25:27.583625 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-152b394d-ae04-4f92-83bb-c59cb4e3ef1e tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 8d43f77a-cb85-4276-9bed-686f306ea21a] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:25:27.589572 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-152b394d-ae04-4f92-83bb-c59cb4e3ef1e tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:27.589860 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-152b394d-ae04-4f92-83bb-c59cb4e3ef1e tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:27.590634 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-152b394d-ae04-4f92-83bb-c59cb4e3ef1e tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:27.591099 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-152b394d-ae04-4f92-83bb-c59cb4e3ef1e tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:27.607045 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-adc3fc08-939b-456d-8111-6059ae9d0107 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-499865434", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-270850616", "security_groups": [{"name": "tempest-secgroup-smoke-532749938"}], "block_device_mapping_v2": [{"uuid": "6810138a-9f06-48b7-9f66-4efca23550e7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "46cf5202-8790-480a-a14a-b087639c31e2"}]}} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:25:27.718097 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.network.neutron [None req-adc3fc08-939b-456d-8111-6059ae9d0107 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] validate_networks() for [('46cf5202-8790-480a-a14a-b087639c31e2', None, None, None, None, None)] {{(pid=117538) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 31 18:25:27.728891 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-152b394d-ae04-4f92-83bb-c59cb4e3ef1e tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:25:27.736734 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-152b394d-ae04-4f92-83bb-c59cb4e3ef1e tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a" status: 200 len: 1367 microversion: 2.1 time: 0.157657 Mar 31 18:25:27.737315 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 436/884] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:25:27 2022] GET /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:25:28.094314 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.virt.hardware [None req-adc3fc08-939b-456d-8111-6059ae9d0107 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Flavor limits 0:0:0 {{(pid=117538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 31 18:25:28.094314 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.virt.hardware [None req-adc3fc08-939b-456d-8111-6059ae9d0107 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Image limits 0:0:0 {{(pid=117538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 31 18:25:28.094314 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.virt.hardware [None req-adc3fc08-939b-456d-8111-6059ae9d0107 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Flavor pref 0:0:0 {{(pid=117538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 31 18:25:28.094314 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.virt.hardware [None req-adc3fc08-939b-456d-8111-6059ae9d0107 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Image pref 0:0:0 {{(pid=117538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 31 18:25:28.094314 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.virt.hardware [None req-adc3fc08-939b-456d-8111-6059ae9d0107 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 31 18:25:28.102803 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-adc3fc08-939b-456d-8111-6059ae9d0107 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:28.103266 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-adc3fc08-939b-456d-8111-6059ae9d0107 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:28.104055 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-adc3fc08-939b-456d-8111-6059ae9d0107 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:28.104481 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-adc3fc08-939b-456d-8111-6059ae9d0107 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:28.121213 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.quota [None req-adc3fc08-939b-456d-8111-6059ae9d0107 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Getting quotas for project 70f0b3390f4542c8831753ecf26f6745. Resources: {'instances', 'ram', 'cores'} {{(pid=117538) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 31 18:25:28.125158 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.quota [None req-adc3fc08-939b-456d-8111-6059ae9d0107 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Getting quotas for user 7c5ea90eba174068877cdcc1594ccda4 and project 70f0b3390f4542c8831753ecf26f6745. Resources: {'instances', 'ram', 'cores'} {{(pid=117538) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 31 18:25:28.182910 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-adc3fc08-939b-456d-8111-6059ae9d0107 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Going to run 1 instances... {{(pid=117538) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 31 18:25:28.185024 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-adc3fc08-939b-456d-8111-6059ae9d0107 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: ef0f516d-f8cb-4c78-8e19-b5d530c90e68] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6810138a-9f06-48b7-9f66-4efca23550e7',volume_size=None,volume_type=None)] {{(pid=117538) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 31 18:25:28.618494 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-adc3fc08-939b-456d-8111-6059ae9d0107 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.015249 Mar 31 18:25:28.619178 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 449/885] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Mar 31 18:25:27 2022] POST /compute/v2.1/servers => generated 405 bytes in 1017 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 31 18:25:28.629698 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-eb11388d-ba4b-4cfb-b0a3-863db6ffb47d tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:25:28.630299 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-eb11388d-ba4b-4cfb-b0a3-863db6ffb47d tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: ef0f516d-f8cb-4c78-8e19-b5d530c90e68] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:25:28.684771 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-eb11388d-ba4b-4cfb-b0a3-863db6ffb47d tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:25:28.692333 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-eb11388d-ba4b-4cfb-b0a3-863db6ffb47d tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/ef0f516d-f8cb-4c78-8e19-b5d530c90e68" status: 200 len: 1093 microversion: 2.1 time: 0.066410 Mar 31 18:25:28.692913 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 437/886] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:25:28 2022] GET /compute/v2.1/servers/ef0f516d-f8cb-4c78-8e19-b5d530c90e68 => generated 1093 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:25:28.754268 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-cb40920c-d5d7-44d8-9c7d-314a2cee8048 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:25:28.754873 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-cb40920c-d5d7-44d8-9c7d-314a2cee8048 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 8d43f77a-cb85-4276-9bed-686f306ea21a] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:25:28.761852 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-cb40920c-d5d7-44d8-9c7d-314a2cee8048 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:28.762498 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-cb40920c-d5d7-44d8-9c7d-314a2cee8048 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:28.763307 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-cb40920c-d5d7-44d8-9c7d-314a2cee8048 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:28.763732 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-cb40920c-d5d7-44d8-9c7d-314a2cee8048 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:28.901582 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-cb40920c-d5d7-44d8-9c7d-314a2cee8048 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:25:28.909118 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-cb40920c-d5d7-44d8-9c7d-314a2cee8048 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a" status: 200 len: 1367 microversion: 2.1 time: 0.159841 Mar 31 18:25:28.909686 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 450/887] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:25:28 2022] GET /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:25:29.709784 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-0a2d3180-4d97-43e7-9447-00fa66ae2f33 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:25:29.710382 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-0a2d3180-4d97-43e7-9447-00fa66ae2f33 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: ef0f516d-f8cb-4c78-8e19-b5d530c90e68] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:25:29.716731 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0a2d3180-4d97-43e7-9447-00fa66ae2f33 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:29.717226 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0a2d3180-4d97-43e7-9447-00fa66ae2f33 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:29.717983 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0a2d3180-4d97-43e7-9447-00fa66ae2f33 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:29.719348 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0a2d3180-4d97-43e7-9447-00fa66ae2f33 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:29.779345 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-0a2d3180-4d97-43e7-9447-00fa66ae2f33 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:25:29.787433 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-0a2d3180-4d97-43e7-9447-00fa66ae2f33 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/ef0f516d-f8cb-4c78-8e19-b5d530c90e68" status: 200 len: 1143 microversion: 2.1 time: 0.081524 Mar 31 18:25:29.787993 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 438/888] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:25:29 2022] GET /compute/v2.1/servers/ef0f516d-f8cb-4c78-8e19-b5d530c90e68 => generated 1143 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:25:29.925309 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-bd25baec-07dc-4c8a-97d2-8bd875a93e37 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:25:29.926061 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-bd25baec-07dc-4c8a-97d2-8bd875a93e37 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 8d43f77a-cb85-4276-9bed-686f306ea21a] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:25:29.932600 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-bd25baec-07dc-4c8a-97d2-8bd875a93e37 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:29.933027 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-bd25baec-07dc-4c8a-97d2-8bd875a93e37 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:29.933795 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-bd25baec-07dc-4c8a-97d2-8bd875a93e37 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:29.934230 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-bd25baec-07dc-4c8a-97d2-8bd875a93e37 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:30.071156 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-bd25baec-07dc-4c8a-97d2-8bd875a93e37 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:25:30.079176 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-bd25baec-07dc-4c8a-97d2-8bd875a93e37 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a" status: 200 len: 1367 microversion: 2.1 time: 0.157809 Mar 31 18:25:30.079736 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 451/889] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:25:29 2022] GET /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:25:30.805122 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-3ce13d79-2467-4fc2-a609-fff637f9ae98 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:25:30.805860 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-3ce13d79-2467-4fc2-a609-fff637f9ae98 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: ef0f516d-f8cb-4c78-8e19-b5d530c90e68] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:25:30.812611 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3ce13d79-2467-4fc2-a609-fff637f9ae98 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:30.813096 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3ce13d79-2467-4fc2-a609-fff637f9ae98 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:30.813905 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3ce13d79-2467-4fc2-a609-fff637f9ae98 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:30.814332 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3ce13d79-2467-4fc2-a609-fff637f9ae98 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:30.877022 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-3ce13d79-2467-4fc2-a609-fff637f9ae98 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:25:30.884797 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-3ce13d79-2467-4fc2-a609-fff637f9ae98 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/ef0f516d-f8cb-4c78-8e19-b5d530c90e68" status: 200 len: 1199 microversion: 2.1 time: 0.083852 Mar 31 18:25:30.885594 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 439/890] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:25:30 2022] GET /compute/v2.1/servers/ef0f516d-f8cb-4c78-8e19-b5d530c90e68 => generated 1199 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:25:31.096962 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-fad174ad-cc2e-430b-ad8c-e62e68aae269 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:25:31.097620 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-fad174ad-cc2e-430b-ad8c-e62e68aae269 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 8d43f77a-cb85-4276-9bed-686f306ea21a] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:25:31.104124 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-fad174ad-cc2e-430b-ad8c-e62e68aae269 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:31.104575 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-fad174ad-cc2e-430b-ad8c-e62e68aae269 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:31.105368 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-fad174ad-cc2e-430b-ad8c-e62e68aae269 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:31.105912 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-fad174ad-cc2e-430b-ad8c-e62e68aae269 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:31.288041 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-fad174ad-cc2e-430b-ad8c-e62e68aae269 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:25:31.293905 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-fad174ad-cc2e-430b-ad8c-e62e68aae269 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a" status: 200 len: 1367 microversion: 2.1 time: 0.202035 Mar 31 18:25:31.294553 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 452/891] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:25:31 2022] GET /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a => generated 1367 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:25:31.902374 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-4f6a73c0-dbba-4687-8261-987d9f1031fa tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:25:31.903583 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-4f6a73c0-dbba-4687-8261-987d9f1031fa tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: ef0f516d-f8cb-4c78-8e19-b5d530c90e68] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:25:31.911027 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-4f6a73c0-dbba-4687-8261-987d9f1031fa tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:31.911684 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-4f6a73c0-dbba-4687-8261-987d9f1031fa tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:31.912636 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-4f6a73c0-dbba-4687-8261-987d9f1031fa tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:31.913241 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-4f6a73c0-dbba-4687-8261-987d9f1031fa tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:32.061847 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-4f6a73c0-dbba-4687-8261-987d9f1031fa tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:25:32.070833 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-4f6a73c0-dbba-4687-8261-987d9f1031fa tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/ef0f516d-f8cb-4c78-8e19-b5d530c90e68" status: 200 len: 1276 microversion: 2.1 time: 0.172154 Mar 31 18:25:32.071415 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 440/892] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:25:31 2022] GET /compute/v2.1/servers/ef0f516d-f8cb-4c78-8e19-b5d530c90e68 => generated 1276 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:25:32.311876 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-55e08a49-9521-4b14-b0fc-96d49adbcacc tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:25:32.313330 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-55e08a49-9521-4b14-b0fc-96d49adbcacc tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 8d43f77a-cb85-4276-9bed-686f306ea21a] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:25:32.319871 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-55e08a49-9521-4b14-b0fc-96d49adbcacc tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:32.320319 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-55e08a49-9521-4b14-b0fc-96d49adbcacc tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:32.321090 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-55e08a49-9521-4b14-b0fc-96d49adbcacc tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:32.321525 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-55e08a49-9521-4b14-b0fc-96d49adbcacc tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:32.525297 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-55e08a49-9521-4b14-b0fc-96d49adbcacc tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:25:32.533142 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-55e08a49-9521-4b14-b0fc-96d49adbcacc tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a" status: 200 len: 1367 microversion: 2.1 time: 0.225790 Mar 31 18:25:32.533719 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 453/893] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:25:32 2022] GET /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a => generated 1367 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:25:32.908582 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [req-45cfed60-c0dd-4110-9353-34d42c89be86 req-e87dc0a8-5025-41a9-9af0-51d2419f53c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef0f516d-f8cb-4c78-8e19-b5d530c90e68", "tag": "adbd679c-b2bc-4261-80ec-b13d349ff692"}]} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:25:32.918953 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-45cfed60-c0dd-4110-9353-34d42c89be86 req-e87dc0a8-5025-41a9-9af0-51d2419f53c3 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:32.918953 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-45cfed60-c0dd-4110-9353-34d42c89be86 req-e87dc0a8-5025-41a9-9af0-51d2419f53c3 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:32.930843 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.compute.server_external_events [req-45cfed60-c0dd-4110-9353-34d42c89be86 req-e87dc0a8-5025-41a9-9af0-51d2419f53c3 service nova] Creating event network-changed:adbd679c-b2bc-4261-80ec-b13d349ff692 for instance ef0f516d-f8cb-4c78-8e19-b5d530c90e68 on hv-cinder-maste Mar 31 18:25:32.935974 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [req-45cfed60-c0dd-4110-9353-34d42c89be86 req-e87dc0a8-5025-41a9-9af0-51d2419f53c3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036717 Mar 31 18:25:32.937800 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 441/894] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:25:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:25:33.088784 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-53cbd819-3b44-41af-947e-1ca604ee1242 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:25:33.089387 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-53cbd819-3b44-41af-947e-1ca604ee1242 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: ef0f516d-f8cb-4c78-8e19-b5d530c90e68] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:25:33.095463 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-53cbd819-3b44-41af-947e-1ca604ee1242 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:33.095900 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-53cbd819-3b44-41af-947e-1ca604ee1242 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:33.096701 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-53cbd819-3b44-41af-947e-1ca604ee1242 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:33.097125 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-53cbd819-3b44-41af-947e-1ca604ee1242 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:33.496302 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-53cbd819-3b44-41af-947e-1ca604ee1242 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:25:33.504239 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-53cbd819-3b44-41af-947e-1ca604ee1242 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/ef0f516d-f8cb-4c78-8e19-b5d530c90e68" status: 200 len: 1264 microversion: 2.1 time: 0.419338 Mar 31 18:25:33.504976 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 454/895] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:25:33 2022] GET /compute/v2.1/servers/ef0f516d-f8cb-4c78-8e19-b5d530c90e68 => generated 1264 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:25:33.552242 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-8ee96e26-34f0-4728-92fd-ec73311f4458 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:25:33.552937 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-8ee96e26-34f0-4728-92fd-ec73311f4458 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 8d43f77a-cb85-4276-9bed-686f306ea21a] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:25:33.558861 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-8ee96e26-34f0-4728-92fd-ec73311f4458 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:33.559301 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-8ee96e26-34f0-4728-92fd-ec73311f4458 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:33.560062 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-8ee96e26-34f0-4728-92fd-ec73311f4458 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:33.560489 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-8ee96e26-34f0-4728-92fd-ec73311f4458 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:33.699449 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-8ee96e26-34f0-4728-92fd-ec73311f4458 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:25:33.707847 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-8ee96e26-34f0-4728-92fd-ec73311f4458 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a" status: 200 len: 1367 microversion: 2.1 time: 0.159790 Mar 31 18:25:33.708728 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 442/896] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:25:33 2022] GET /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:25:33.872307 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [req-1caf3dff-5252-43f1-b6bf-7f39c0480ffd req-ff05274d-1b28-4764-95e7-4b82dd04446e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d43f77a-cb85-4276-9bed-686f306ea21a", "name": "network-vif-plugged", "status": "completed", "tag": "66cb4db2-f182-4e79-945c-41d2828096bb"}]} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:25:33.880317 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-1caf3dff-5252-43f1-b6bf-7f39c0480ffd req-ff05274d-1b28-4764-95e7-4b82dd04446e service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:33.880758 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-1caf3dff-5252-43f1-b6bf-7f39c0480ffd req-ff05274d-1b28-4764-95e7-4b82dd04446e service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:33.893447 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.compute.server_external_events [req-1caf3dff-5252-43f1-b6bf-7f39c0480ffd req-ff05274d-1b28-4764-95e7-4b82dd04446e service nova] Creating event network-vif-plugged:66cb4db2-f182-4e79-945c-41d2828096bb for instance 8d43f77a-cb85-4276-9bed-686f306ea21a on hv-cinder-maste Mar 31 18:25:33.898327 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [req-1caf3dff-5252-43f1-b6bf-7f39c0480ffd req-ff05274d-1b28-4764-95e7-4b82dd04446e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.082430 Mar 31 18:25:33.898961 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 455/897] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:25:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 31 18:25:34.522662 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-4799cdba-b3d5-4fc1-9e69-959700ee9197 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:25:34.523292 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-4799cdba-b3d5-4fc1-9e69-959700ee9197 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: ef0f516d-f8cb-4c78-8e19-b5d530c90e68] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:25:34.529112 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-4799cdba-b3d5-4fc1-9e69-959700ee9197 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:34.529530 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-4799cdba-b3d5-4fc1-9e69-959700ee9197 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:34.530268 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-4799cdba-b3d5-4fc1-9e69-959700ee9197 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:34.530729 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-4799cdba-b3d5-4fc1-9e69-959700ee9197 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:34.665647 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-4799cdba-b3d5-4fc1-9e69-959700ee9197 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:25:34.672928 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-4799cdba-b3d5-4fc1-9e69-959700ee9197 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/ef0f516d-f8cb-4c78-8e19-b5d530c90e68" status: 200 len: 1264 microversion: 2.1 time: 0.154629 Mar 31 18:25:34.673485 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 443/898] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:25:34 2022] GET /compute/v2.1/servers/ef0f516d-f8cb-4c78-8e19-b5d530c90e68 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:25:34.725777 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-64a9082a-f815-4947-b948-e4cf1dfa96f1 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:25:34.726465 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-64a9082a-f815-4947-b948-e4cf1dfa96f1 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 8d43f77a-cb85-4276-9bed-686f306ea21a] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:25:34.732606 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-64a9082a-f815-4947-b948-e4cf1dfa96f1 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:34.733093 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-64a9082a-f815-4947-b948-e4cf1dfa96f1 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:34.733855 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-64a9082a-f815-4947-b948-e4cf1dfa96f1 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:34.734278 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-64a9082a-f815-4947-b948-e4cf1dfa96f1 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:34.870204 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-64a9082a-f815-4947-b948-e4cf1dfa96f1 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:25:34.878025 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-64a9082a-f815-4947-b948-e4cf1dfa96f1 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a" status: 200 len: 1367 microversion: 2.1 time: 0.156874 Mar 31 18:25:34.878591 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 456/899] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:25:34 2022] GET /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:25:35.689720 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-98a7c02b-ef5a-4c3f-85d8-fd25014975bc tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:25:35.690322 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-98a7c02b-ef5a-4c3f-85d8-fd25014975bc tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: ef0f516d-f8cb-4c78-8e19-b5d530c90e68] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:25:35.696264 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-98a7c02b-ef5a-4c3f-85d8-fd25014975bc tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:35.696700 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-98a7c02b-ef5a-4c3f-85d8-fd25014975bc tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:35.697450 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-98a7c02b-ef5a-4c3f-85d8-fd25014975bc tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:35.697877 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-98a7c02b-ef5a-4c3f-85d8-fd25014975bc tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:35.833565 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-98a7c02b-ef5a-4c3f-85d8-fd25014975bc tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:25:35.840943 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-98a7c02b-ef5a-4c3f-85d8-fd25014975bc tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/ef0f516d-f8cb-4c78-8e19-b5d530c90e68" status: 200 len: 1264 microversion: 2.1 time: 0.155128 Mar 31 18:25:35.841507 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 444/900] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:25:35 2022] GET /compute/v2.1/servers/ef0f516d-f8cb-4c78-8e19-b5d530c90e68 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:25:35.895523 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-61a9b510-a059-426a-bb58-518dfd566273 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:25:35.896145 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-61a9b510-a059-426a-bb58-518dfd566273 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 8d43f77a-cb85-4276-9bed-686f306ea21a] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:25:35.902385 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-61a9b510-a059-426a-bb58-518dfd566273 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:35.902880 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-61a9b510-a059-426a-bb58-518dfd566273 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:35.903709 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-61a9b510-a059-426a-bb58-518dfd566273 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:35.904163 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-61a9b510-a059-426a-bb58-518dfd566273 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:36.045062 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-61a9b510-a059-426a-bb58-518dfd566273 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:25:36.052674 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-61a9b510-a059-426a-bb58-518dfd566273 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a" status: 200 len: 1367 microversion: 2.1 time: 0.161602 Mar 31 18:25:36.053480 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 457/901] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:25:35 2022] GET /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:25:36.859122 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-b42a502e-7f1b-49a6-bf5b-92be7bcac05c tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:25:36.859715 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-b42a502e-7f1b-49a6-bf5b-92be7bcac05c tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: ef0f516d-f8cb-4c78-8e19-b5d530c90e68] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:25:36.865991 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b42a502e-7f1b-49a6-bf5b-92be7bcac05c tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:36.866436 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b42a502e-7f1b-49a6-bf5b-92be7bcac05c tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:36.867227 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b42a502e-7f1b-49a6-bf5b-92be7bcac05c tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:36.867654 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b42a502e-7f1b-49a6-bf5b-92be7bcac05c tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:37.008846 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-b42a502e-7f1b-49a6-bf5b-92be7bcac05c tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:25:37.016361 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-b42a502e-7f1b-49a6-bf5b-92be7bcac05c tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/ef0f516d-f8cb-4c78-8e19-b5d530c90e68" status: 200 len: 1264 microversion: 2.1 time: 0.161326 Mar 31 18:25:37.016923 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 445/902] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:25:36 2022] GET /compute/v2.1/servers/ef0f516d-f8cb-4c78-8e19-b5d530c90e68 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:25:37.069154 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-0ff42302-cf1a-4540-b280-323c87745158 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:25:37.069783 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-0ff42302-cf1a-4540-b280-323c87745158 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 8d43f77a-cb85-4276-9bed-686f306ea21a] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:25:37.076119 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-0ff42302-cf1a-4540-b280-323c87745158 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:37.076570 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-0ff42302-cf1a-4540-b280-323c87745158 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:37.077306 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-0ff42302-cf1a-4540-b280-323c87745158 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:37.077731 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-0ff42302-cf1a-4540-b280-323c87745158 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:37.208917 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-0ff42302-cf1a-4540-b280-323c87745158 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:25:37.216210 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-0ff42302-cf1a-4540-b280-323c87745158 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a" status: 200 len: 1556 microversion: 2.1 time: 0.150928 Mar 31 18:25:37.216771 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 458/903] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:25:37 2022] GET /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a => generated 1556 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:25:37.233011 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-05f03708-7a31-4c54-9675-9feaa3ed485c tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:25:37.233495 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-05f03708-7a31-4c54-9675-9feaa3ed485c tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 8d43f77a-cb85-4276-9bed-686f306ea21a] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:25:37.239379 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-05f03708-7a31-4c54-9675-9feaa3ed485c tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:37.239820 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-05f03708-7a31-4c54-9675-9feaa3ed485c tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:37.240571 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-05f03708-7a31-4c54-9675-9feaa3ed485c tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:37.241000 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-05f03708-7a31-4c54-9675-9feaa3ed485c tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:37.323133 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-05f03708-7a31-4c54-9675-9feaa3ed485c tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093986 Mar 31 18:25:37.323727 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 446/904] 10.222.0.58 () {58 vars in 1274 bytes} [Thu Mar 31 18:25:37 2022] GET /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:25:38.033718 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-f665ff1d-05a9-4e03-8f0f-d6c0c5791bfb tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:25:38.034362 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-f665ff1d-05a9-4e03-8f0f-d6c0c5791bfb tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: ef0f516d-f8cb-4c78-8e19-b5d530c90e68] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:25:38.042015 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f665ff1d-05a9-4e03-8f0f-d6c0c5791bfb tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:38.042468 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f665ff1d-05a9-4e03-8f0f-d6c0c5791bfb tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:38.043294 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f665ff1d-05a9-4e03-8f0f-d6c0c5791bfb tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:38.043733 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f665ff1d-05a9-4e03-8f0f-d6c0c5791bfb tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:38.193373 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-f665ff1d-05a9-4e03-8f0f-d6c0c5791bfb tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:25:38.200827 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-f665ff1d-05a9-4e03-8f0f-d6c0c5791bfb tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/ef0f516d-f8cb-4c78-8e19-b5d530c90e68" status: 200 len: 1264 microversion: 2.1 time: 0.171221 Mar 31 18:25:38.201650 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 459/905] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:25:38 2022] GET /compute/v2.1/servers/ef0f516d-f8cb-4c78-8e19-b5d530c90e68 => generated 1264 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:25:38.660727 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [req-e3f12b01-5026-4f80-bbe4-dd8a3e671175 req-21da9db6-b2d6-48f1-aa0f-b09cf8902211 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8d43f77a-cb85-4276-9bed-686f306ea21a", "tag": "66cb4db2-f182-4e79-945c-41d2828096bb"}]} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:25:38.669045 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-e3f12b01-5026-4f80-bbe4-dd8a3e671175 req-21da9db6-b2d6-48f1-aa0f-b09cf8902211 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:38.669474 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-e3f12b01-5026-4f80-bbe4-dd8a3e671175 req-21da9db6-b2d6-48f1-aa0f-b09cf8902211 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:38.681914 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.compute.server_external_events [req-e3f12b01-5026-4f80-bbe4-dd8a3e671175 req-21da9db6-b2d6-48f1-aa0f-b09cf8902211 service nova] Creating event network-changed:66cb4db2-f182-4e79-945c-41d2828096bb for instance 8d43f77a-cb85-4276-9bed-686f306ea21a on hv-cinder-maste Mar 31 18:25:38.687191 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [req-e3f12b01-5026-4f80-bbe4-dd8a3e671175 req-21da9db6-b2d6-48f1-aa0f-b09cf8902211 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.092222 Mar 31 18:25:38.687803 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 447/906] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:25:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:25:39.218710 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-835027b4-7cae-4283-a7de-118f1fa7f2eb tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:25:39.219958 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-835027b4-7cae-4283-a7de-118f1fa7f2eb tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: ef0f516d-f8cb-4c78-8e19-b5d530c90e68] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:25:39.227819 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-835027b4-7cae-4283-a7de-118f1fa7f2eb tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:39.228270 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-835027b4-7cae-4283-a7de-118f1fa7f2eb tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:39.229057 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-835027b4-7cae-4283-a7de-118f1fa7f2eb tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:39.229524 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-835027b4-7cae-4283-a7de-118f1fa7f2eb tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:39.372231 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-835027b4-7cae-4283-a7de-118f1fa7f2eb tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:25:39.380913 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-835027b4-7cae-4283-a7de-118f1fa7f2eb tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/ef0f516d-f8cb-4c78-8e19-b5d530c90e68" status: 200 len: 1264 microversion: 2.1 time: 0.166054 Mar 31 18:25:39.381501 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 460/907] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:25:39 2022] GET /compute/v2.1/servers/ef0f516d-f8cb-4c78-8e19-b5d530c90e68 => generated 1264 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:25:40.398457 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-b5a604d8-7589-4a48-b2d9-47197a9dd41c tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:25:40.399219 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-b5a604d8-7589-4a48-b2d9-47197a9dd41c tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: ef0f516d-f8cb-4c78-8e19-b5d530c90e68] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:25:40.405212 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b5a604d8-7589-4a48-b2d9-47197a9dd41c tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:40.405675 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b5a604d8-7589-4a48-b2d9-47197a9dd41c tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:40.406436 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b5a604d8-7589-4a48-b2d9-47197a9dd41c tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:40.406885 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b5a604d8-7589-4a48-b2d9-47197a9dd41c tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:40.544064 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-b5a604d8-7589-4a48-b2d9-47197a9dd41c tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:25:40.551464 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-b5a604d8-7589-4a48-b2d9-47197a9dd41c tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/ef0f516d-f8cb-4c78-8e19-b5d530c90e68" status: 200 len: 1264 microversion: 2.1 time: 0.157879 Mar 31 18:25:40.552013 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 448/908] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:25:40 2022] GET /compute/v2.1/servers/ef0f516d-f8cb-4c78-8e19-b5d530c90e68 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:25:41.568908 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-f93b6080-42b0-4670-a760-f847c1169b3a tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:25:41.569519 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-f93b6080-42b0-4670-a760-f847c1169b3a tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: ef0f516d-f8cb-4c78-8e19-b5d530c90e68] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:25:41.575797 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f93b6080-42b0-4670-a760-f847c1169b3a tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:41.576238 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f93b6080-42b0-4670-a760-f847c1169b3a tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:41.576994 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f93b6080-42b0-4670-a760-f847c1169b3a tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:41.577425 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f93b6080-42b0-4670-a760-f847c1169b3a tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:41.710718 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-f93b6080-42b0-4670-a760-f847c1169b3a tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:25:41.717929 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-f93b6080-42b0-4670-a760-f847c1169b3a tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/ef0f516d-f8cb-4c78-8e19-b5d530c90e68" status: 200 len: 1264 microversion: 2.1 time: 0.153650 Mar 31 18:25:41.718483 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 461/909] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:25:41 2022] GET /compute/v2.1/servers/ef0f516d-f8cb-4c78-8e19-b5d530c90e68 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:25:42.734875 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-1ec458b7-3431-4302-aaca-91e7bfd48c93 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:25:42.735527 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-1ec458b7-3431-4302-aaca-91e7bfd48c93 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: ef0f516d-f8cb-4c78-8e19-b5d530c90e68] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:25:42.741466 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1ec458b7-3431-4302-aaca-91e7bfd48c93 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:42.741905 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1ec458b7-3431-4302-aaca-91e7bfd48c93 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:42.742677 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1ec458b7-3431-4302-aaca-91e7bfd48c93 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:42.743108 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1ec458b7-3431-4302-aaca-91e7bfd48c93 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:42.877000 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-1ec458b7-3431-4302-aaca-91e7bfd48c93 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:25:42.884480 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-1ec458b7-3431-4302-aaca-91e7bfd48c93 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/ef0f516d-f8cb-4c78-8e19-b5d530c90e68" status: 200 len: 1264 microversion: 2.1 time: 0.153559 Mar 31 18:25:42.885033 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 449/910] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:25:42 2022] GET /compute/v2.1/servers/ef0f516d-f8cb-4c78-8e19-b5d530c90e68 => generated 1264 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:25:43.901339 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-45cdffda-5378-43aa-8040-cd263650c8e3 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:25:43.901988 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-45cdffda-5378-43aa-8040-cd263650c8e3 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: ef0f516d-f8cb-4c78-8e19-b5d530c90e68] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:25:43.908183 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-45cdffda-5378-43aa-8040-cd263650c8e3 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:43.908632 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-45cdffda-5378-43aa-8040-cd263650c8e3 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:43.909387 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-45cdffda-5378-43aa-8040-cd263650c8e3 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:43.909828 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-45cdffda-5378-43aa-8040-cd263650c8e3 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:44.044795 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-45cdffda-5378-43aa-8040-cd263650c8e3 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:25:44.052601 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-45cdffda-5378-43aa-8040-cd263650c8e3 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/ef0f516d-f8cb-4c78-8e19-b5d530c90e68" status: 200 len: 1264 microversion: 2.1 time: 0.155148 Mar 31 18:25:44.059299 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 462/911] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:25:43 2022] GET /compute/v2.1/servers/ef0f516d-f8cb-4c78-8e19-b5d530c90e68 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:25:45.069598 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-cbde93bd-fb42-476c-9dbd-21bb854dab81 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:25:45.070289 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-cbde93bd-fb42-476c-9dbd-21bb854dab81 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: ef0f516d-f8cb-4c78-8e19-b5d530c90e68] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:25:45.076152 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-cbde93bd-fb42-476c-9dbd-21bb854dab81 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:45.076594 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-cbde93bd-fb42-476c-9dbd-21bb854dab81 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:45.077353 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-cbde93bd-fb42-476c-9dbd-21bb854dab81 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:45.077783 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-cbde93bd-fb42-476c-9dbd-21bb854dab81 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:45.217233 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-cbde93bd-fb42-476c-9dbd-21bb854dab81 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:25:45.220959 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-cbde93bd-fb42-476c-9dbd-21bb854dab81 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/ef0f516d-f8cb-4c78-8e19-b5d530c90e68" status: 200 len: 1264 microversion: 2.1 time: 0.155517 Mar 31 18:25:45.221558 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 450/912] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:25:45 2022] GET /compute/v2.1/servers/ef0f516d-f8cb-4c78-8e19-b5d530c90e68 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:25:45.901422 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [req-f353def0-e835-4792-8ed6-f5e4d1951051 req-508f1e43-3736-4d35-9795-c36b32fa361c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef0f516d-f8cb-4c78-8e19-b5d530c90e68", "name": "network-vif-plugged", "status": "completed", "tag": "adbd679c-b2bc-4261-80ec-b13d349ff692"}]} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:25:45.909232 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-f353def0-e835-4792-8ed6-f5e4d1951051 req-508f1e43-3736-4d35-9795-c36b32fa361c service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:45.909671 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-f353def0-e835-4792-8ed6-f5e4d1951051 req-508f1e43-3736-4d35-9795-c36b32fa361c service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:45.920894 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.compute.server_external_events [req-f353def0-e835-4792-8ed6-f5e4d1951051 req-508f1e43-3736-4d35-9795-c36b32fa361c service nova] Creating event network-vif-plugged:adbd679c-b2bc-4261-80ec-b13d349ff692 for instance ef0f516d-f8cb-4c78-8e19-b5d530c90e68 on hv-cinder-maste Mar 31 18:25:45.927013 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [req-f353def0-e835-4792-8ed6-f5e4d1951051 req-508f1e43-3736-4d35-9795-c36b32fa361c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028353 Mar 31 18:25:45.927013 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 463/913] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:25:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 31 18:25:46.238862 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-3f44f8e7-d03f-4f9b-bbff-fcd5de3fea73 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:25:46.239530 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-3f44f8e7-d03f-4f9b-bbff-fcd5de3fea73 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: ef0f516d-f8cb-4c78-8e19-b5d530c90e68] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:25:46.245340 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3f44f8e7-d03f-4f9b-bbff-fcd5de3fea73 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:46.247001 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3f44f8e7-d03f-4f9b-bbff-fcd5de3fea73 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:46.247001 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3f44f8e7-d03f-4f9b-bbff-fcd5de3fea73 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:46.247001 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3f44f8e7-d03f-4f9b-bbff-fcd5de3fea73 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:46.388536 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-3f44f8e7-d03f-4f9b-bbff-fcd5de3fea73 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:25:46.396777 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-3f44f8e7-d03f-4f9b-bbff-fcd5de3fea73 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/ef0f516d-f8cb-4c78-8e19-b5d530c90e68" status: 200 len: 1264 microversion: 2.1 time: 0.162315 Mar 31 18:25:46.397450 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 451/914] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:25:46 2022] GET /compute/v2.1/servers/ef0f516d-f8cb-4c78-8e19-b5d530c90e68 => generated 1264 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:25:47.414345 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-1e23898e-ca2b-4b44-acd6-394854eb3c27 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:25:47.414972 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-1e23898e-ca2b-4b44-acd6-394854eb3c27 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: ef0f516d-f8cb-4c78-8e19-b5d530c90e68] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:25:47.421055 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-1e23898e-ca2b-4b44-acd6-394854eb3c27 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:47.421501 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-1e23898e-ca2b-4b44-acd6-394854eb3c27 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:47.422256 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-1e23898e-ca2b-4b44-acd6-394854eb3c27 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:47.422731 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-1e23898e-ca2b-4b44-acd6-394854eb3c27 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:47.561069 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-1e23898e-ca2b-4b44-acd6-394854eb3c27 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:25:47.569063 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-1e23898e-ca2b-4b44-acd6-394854eb3c27 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/ef0f516d-f8cb-4c78-8e19-b5d530c90e68" status: 200 len: 1264 microversion: 2.1 time: 0.159470 Mar 31 18:25:47.569616 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 464/915] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:25:47 2022] GET /compute/v2.1/servers/ef0f516d-f8cb-4c78-8e19-b5d530c90e68 => generated 1264 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:25:48.585878 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-3d5e8bd9-acca-44d6-80c6-f5e1592837de tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:25:48.586513 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-3d5e8bd9-acca-44d6-80c6-f5e1592837de tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: ef0f516d-f8cb-4c78-8e19-b5d530c90e68] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:25:48.592413 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3d5e8bd9-acca-44d6-80c6-f5e1592837de tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:48.592859 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3d5e8bd9-acca-44d6-80c6-f5e1592837de tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:48.593608 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3d5e8bd9-acca-44d6-80c6-f5e1592837de tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:48.594028 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3d5e8bd9-acca-44d6-80c6-f5e1592837de tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:48.735791 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-3d5e8bd9-acca-44d6-80c6-f5e1592837de tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:25:48.743742 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-3d5e8bd9-acca-44d6-80c6-f5e1592837de tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/ef0f516d-f8cb-4c78-8e19-b5d530c90e68" status: 200 len: 1264 microversion: 2.1 time: 0.162314 Mar 31 18:25:48.744310 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 452/916] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:25:48 2022] GET /compute/v2.1/servers/ef0f516d-f8cb-4c78-8e19-b5d530c90e68 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:25:49.762137 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-100bc0e7-1b37-4c08-89b1-f3d37b2ff779 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:25:49.762865 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-100bc0e7-1b37-4c08-89b1-f3d37b2ff779 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: ef0f516d-f8cb-4c78-8e19-b5d530c90e68] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:25:49.769249 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-100bc0e7-1b37-4c08-89b1-f3d37b2ff779 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:49.769692 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-100bc0e7-1b37-4c08-89b1-f3d37b2ff779 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:49.770446 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-100bc0e7-1b37-4c08-89b1-f3d37b2ff779 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:49.770899 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-100bc0e7-1b37-4c08-89b1-f3d37b2ff779 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:49.907597 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-100bc0e7-1b37-4c08-89b1-f3d37b2ff779 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:25:49.915386 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-100bc0e7-1b37-4c08-89b1-f3d37b2ff779 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/ef0f516d-f8cb-4c78-8e19-b5d530c90e68" status: 200 len: 1451 microversion: 2.1 time: 0.157438 Mar 31 18:25:49.915946 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 465/917] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:25:49 2022] GET /compute/v2.1/servers/ef0f516d-f8cb-4c78-8e19-b5d530c90e68 => generated 1451 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:25:49.931902 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-3480e8da-ae22-474b-82d8-aef44abcb701 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:25:49.932508 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-3480e8da-ae22-474b-82d8-aef44abcb701 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: ef0f516d-f8cb-4c78-8e19-b5d530c90e68] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:25:49.938236 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3480e8da-ae22-474b-82d8-aef44abcb701 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:49.938704 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3480e8da-ae22-474b-82d8-aef44abcb701 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:49.939452 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3480e8da-ae22-474b-82d8-aef44abcb701 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:49.939874 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3480e8da-ae22-474b-82d8-aef44abcb701 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:50.076839 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-3480e8da-ae22-474b-82d8-aef44abcb701 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:25:50.084159 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-3480e8da-ae22-474b-82d8-aef44abcb701 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/ef0f516d-f8cb-4c78-8e19-b5d530c90e68" status: 200 len: 1451 microversion: 2.1 time: 0.156783 Mar 31 18:25:50.084721 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 453/918] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:25:49 2022] GET /compute/v2.1/servers/ef0f516d-f8cb-4c78-8e19-b5d530c90e68 => generated 1451 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:25:52.241889 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [req-717aaa95-57fb-4f5b-ad03-58ad97342db0 req-ff4d250f-7022-45e4-bc45-394b38424e7c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef0f516d-f8cb-4c78-8e19-b5d530c90e68", "tag": "adbd679c-b2bc-4261-80ec-b13d349ff692"}]} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:25:52.250322 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-717aaa95-57fb-4f5b-ad03-58ad97342db0 req-ff4d250f-7022-45e4-bc45-394b38424e7c service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:25:52.250804 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-717aaa95-57fb-4f5b-ad03-58ad97342db0 req-ff4d250f-7022-45e4-bc45-394b38424e7c service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:25:52.261929 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.compute.server_external_events [req-717aaa95-57fb-4f5b-ad03-58ad97342db0 req-ff4d250f-7022-45e4-bc45-394b38424e7c service nova] Creating event network-changed:adbd679c-b2bc-4261-80ec-b13d349ff692 for instance ef0f516d-f8cb-4c78-8e19-b5d530c90e68 on hv-cinder-maste Mar 31 18:25:52.267568 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [req-717aaa95-57fb-4f5b-ad03-58ad97342db0 req-ff4d250f-7022-45e4-bc45-394b38424e7c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029392 Mar 31 18:25:52.268153 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 466/919] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:25:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:26:43.989398 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-0f5238ac-2364-4ad0-be18-da0c19858da0 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:26:43.995248 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-0f5238ac-2364-4ad0-be18-da0c19858da0 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:26:43.996176 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0f5238ac-2364-4ad0-be18-da0c19858da0 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:26:43.996654 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0f5238ac-2364-4ad0-be18-da0c19858da0 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:26:43.997427 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0f5238ac-2364-4ad0-be18-da0c19858da0 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:26:43.997848 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0f5238ac-2364-4ad0-be18-da0c19858da0 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:26:44.026541 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-0f5238ac-2364-4ad0-be18-da0c19858da0 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041478 Mar 31 18:26:44.027112 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 454/920] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Mar 31 18:26:43 2022] GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 31 18:26:44.103336 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-8fb73493-9670-469f-b108-5ed269dc8363 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:26:44.103909 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-8fb73493-9670-469f-b108-5ed269dc8363 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:26:44.110371 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8fb73493-9670-469f-b108-5ed269dc8363 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:26:44.110881 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8fb73493-9670-469f-b108-5ed269dc8363 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:26:44.112300 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8fb73493-9670-469f-b108-5ed269dc8363 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:26:44.112821 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8fb73493-9670-469f-b108-5ed269dc8363 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:26:44.138778 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-8fb73493-9670-469f-b108-5ed269dc8363 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Going to try to terminate instance {{(pid=117538) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 31 18:26:44.502506 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-8fb73493-9670-469f-b108-5ed269dc8363 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "DELETE /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58" status: 204 len: 0 microversion: 2.1 time: 0.404960 Mar 31 18:26:44.503430 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 467/921] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Mar 31 18:26:44 2022] DELETE /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 31 18:26:44.512438 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-94840f9b-ba10-4da3-8a8f-ca59d83cfb3d tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:26:44.513726 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-94840f9b-ba10-4da3-8a8f-ca59d83cfb3d tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:26:44.520830 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-94840f9b-ba10-4da3-8a8f-ca59d83cfb3d tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:26:44.521574 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-94840f9b-ba10-4da3-8a8f-ca59d83cfb3d tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:26:44.522521 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-94840f9b-ba10-4da3-8a8f-ca59d83cfb3d tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:26:44.523049 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-94840f9b-ba10-4da3-8a8f-ca59d83cfb3d tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:26:44.663878 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-94840f9b-ba10-4da3-8a8f-ca59d83cfb3d tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:26:44.671359 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-94840f9b-ba10-4da3-8a8f-ca59d83cfb3d tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58" status: 200 len: 1674 microversion: 2.1 time: 0.162813 Mar 31 18:26:44.671921 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 455/922] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:26:44 2022] GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58 => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:26:45.690512 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-215c28bc-3c09-46d2-ad80-091f6cf59f99 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:26:45.691739 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-215c28bc-3c09-46d2-ad80-091f6cf59f99 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:26:45.697564 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-215c28bc-3c09-46d2-ad80-091f6cf59f99 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:26:45.698001 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-215c28bc-3c09-46d2-ad80-091f6cf59f99 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:26:45.698811 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-215c28bc-3c09-46d2-ad80-091f6cf59f99 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:26:45.699241 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-215c28bc-3c09-46d2-ad80-091f6cf59f99 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:26:45.839832 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-215c28bc-3c09-46d2-ad80-091f6cf59f99 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:26:45.847127 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-215c28bc-3c09-46d2-ad80-091f6cf59f99 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58" status: 200 len: 1674 microversion: 2.1 time: 0.160776 Mar 31 18:26:45.847689 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 468/923] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:26:45 2022] GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58 => generated 1674 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:26:46.865132 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-9c17a31d-f586-4e18-8086-30bb50d152eb tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:26:46.865744 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-9c17a31d-f586-4e18-8086-30bb50d152eb tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:26:46.871762 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9c17a31d-f586-4e18-8086-30bb50d152eb tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:26:46.872199 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9c17a31d-f586-4e18-8086-30bb50d152eb tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:26:46.873019 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9c17a31d-f586-4e18-8086-30bb50d152eb tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:26:46.873386 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9c17a31d-f586-4e18-8086-30bb50d152eb tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:26:47.014114 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-9c17a31d-f586-4e18-8086-30bb50d152eb tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:26:47.022827 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-9c17a31d-f586-4e18-8086-30bb50d152eb tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58" status: 200 len: 1674 microversion: 2.1 time: 0.162191 Mar 31 18:26:47.023413 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 456/924] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:26:46 2022] GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58 => generated 1674 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:26:48.041444 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-c229a6c5-d870-4e99-916b-b2b9241d6023 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:26:48.041977 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-c229a6c5-d870-4e99-916b-b2b9241d6023 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:26:48.048683 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c229a6c5-d870-4e99-916b-b2b9241d6023 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:26:48.049131 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c229a6c5-d870-4e99-916b-b2b9241d6023 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:26:48.049901 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c229a6c5-d870-4e99-916b-b2b9241d6023 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:26:48.050899 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c229a6c5-d870-4e99-916b-b2b9241d6023 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:26:48.132392 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-c229a6c5-d870-4e99-916b-b2b9241d6023 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:26:48.139961 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-c229a6c5-d870-4e99-916b-b2b9241d6023 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58" status: 200 len: 1606 microversion: 2.1 time: 0.102659 Mar 31 18:26:48.140776 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 469/925] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:26:48 2022] GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58 => generated 1606 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:26:48.675573 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [req-460620ac-f7fb-4956-b12c-deea69416b33 req-3d4ed36c-070c-40bc-8277-65023dc0acbc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "01ac6bc8-6406-46d8-b8a1-628449e68e58", "name": "network-vif-deleted", "tag": "39569c59-56fb-4b13-b985-d8cf317000fa"}]} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:26:48.684699 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-460620ac-f7fb-4956-b12c-deea69416b33 req-3d4ed36c-070c-40bc-8277-65023dc0acbc service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:26:48.685728 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-460620ac-f7fb-4956-b12c-deea69416b33 req-3d4ed36c-070c-40bc-8277-65023dc0acbc service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:26:48.699341 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.compute.server_external_events [req-460620ac-f7fb-4956-b12c-deea69416b33 req-3d4ed36c-070c-40bc-8277-65023dc0acbc service nova] Creating event network-vif-deleted:39569c59-56fb-4b13-b985-d8cf317000fa for instance 01ac6bc8-6406-46d8-b8a1-628449e68e58 on hv-cinder-maste Mar 31 18:26:48.706034 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [req-460620ac-f7fb-4956-b12c-deea69416b33 req-3d4ed36c-070c-40bc-8277-65023dc0acbc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035712 Mar 31 18:26:48.707688 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 457/926] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:26:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:26:49.157910 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-7374dd15-ae91-4a66-8877-d4b2099e7974 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:26:49.159249 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-7374dd15-ae91-4a66-8877-d4b2099e7974 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:26:49.166504 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-7374dd15-ae91-4a66-8877-d4b2099e7974 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:26:49.166978 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-7374dd15-ae91-4a66-8877-d4b2099e7974 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:26:49.167745 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-7374dd15-ae91-4a66-8877-d4b2099e7974 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:26:49.168438 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-7374dd15-ae91-4a66-8877-d4b2099e7974 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:26:49.200384 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-7374dd15-ae91-4a66-8877-d4b2099e7974 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:26:49.200825 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-7374dd15-ae91-4a66-8877-d4b2099e7974 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:26:49.201265 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.objects.instance [None req-7374dd15-ae91-4a66-8877-d4b2099e7974 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lazy-loading 'fault' on Instance uuid 01ac6bc8-6406-46d8-b8a1-628449e68e58 {{(pid=117538) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 31 18:26:49.244867 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-7374dd15-ae91-4a66-8877-d4b2099e7974 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:26:49.252465 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-7374dd15-ae91-4a66-8877-d4b2099e7974 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58" status: 200 len: 1326 microversion: 2.1 time: 0.098561 Mar 31 18:26:49.253038 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 470/927] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:26:49 2022] GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58 => generated 1326 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:26:50.271854 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-e85bad10-76bc-4601-8fc8-6f21ef9d2991 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:26:50.272535 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-e85bad10-76bc-4601-8fc8-6f21ef9d2991 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:26:50.278820 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e85bad10-76bc-4601-8fc8-6f21ef9d2991 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:26:50.279260 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e85bad10-76bc-4601-8fc8-6f21ef9d2991 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:26:50.280018 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e85bad10-76bc-4601-8fc8-6f21ef9d2991 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:26:50.280454 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e85bad10-76bc-4601-8fc8-6f21ef9d2991 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:26:50.293095 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.wsgi [None req-e85bad10-76bc-4601-8fc8-6f21ef9d2991 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] HTTP exception thrown: Instance 01ac6bc8-6406-46d8-b8a1-628449e68e58 could not be found. Mar 31 18:26:50.293674 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-e85bad10-76bc-4601-8fc8-6f21ef9d2991 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Returning 404 to user: Instance 01ac6bc8-6406-46d8-b8a1-628449e68e58 could not be found. {{(pid=117539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:26:50.294522 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-e85bad10-76bc-4601-8fc8-6f21ef9d2991 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58" status: 404 len: 111 microversion: 2.1 time: 0.027101 Mar 31 18:26:50.295078 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 458/928] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:26:50 2022] GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 31 18:26:50.303832 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-c07a6200-89e6-44b9-a49f-e7d7c9e27577 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '.version_select at 0x7fa4d43be820>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:26:50.388894 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-c07a6200-89e6-44b9-a49f-e7d7c9e27577 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-586943772" status: 202 len: 0 microversion: 2.1 time: 0.089272 Mar 31 18:26:50.389421 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 471/929] 10.222.0.58 () {58 vars in 1217 bytes} [Thu Mar 31 18:26:50 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-586943772 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 31 18:26:51.241783 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-05b65bf9-a079-4b2a-bb0e-dbdbf8ff7af8 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Action: 'create', calling method: .version_select at 0x7fa4d41ba310>, body: {"keypair": {"name": "tempest-keypair-60832592"}} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:26:51.255284 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.quota [None req-05b65bf9-a079-4b2a-bb0e-dbdbf8ff7af8 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Getting quotas for project 87baab8d37b040efbfe030d17be30823. Resources: {'key_pairs'} {{(pid=117539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 31 18:26:51.258933 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.quota [None req-05b65bf9-a079-4b2a-bb0e-dbdbf8ff7af8 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Getting quotas for user c1a075de217449d9a941a7bc3c4c99c3 and project 87baab8d37b040efbfe030d17be30823. Resources: {'key_pairs'} {{(pid=117539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 31 18:26:51.488505 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.quota [None req-05b65bf9-a079-4b2a-bb0e-dbdbf8ff7af8 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Getting quotas for project 87baab8d37b040efbfe030d17be30823. Resources: {'key_pairs'} {{(pid=117539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 31 18:26:51.492120 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.quota [None req-05b65bf9-a079-4b2a-bb0e-dbdbf8ff7af8 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Getting quotas for user c1a075de217449d9a941a7bc3c4c99c3 and project 87baab8d37b040efbfe030d17be30823. Resources: {'key_pairs'} {{(pid=117539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 31 18:26:51.504837 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-05b65bf9-a079-4b2a-bb0e-dbdbf8ff7af8 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 2303 microversion: 2.1 time: 0.267551 Mar 31 18:26:51.505415 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 459/930] 10.222.0.58 () {60 vars in 1157 bytes} [Thu Mar 31 18:26:51 2022] POST /compute/v2.1/os-keypairs => generated 2303 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:26:53.827956 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-5f0c8d41-8f83-496f-8812-6fec3daa5a0e tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-972689316", "imageRef": "6241b999-6f6d-4076-88bc-345fa7386256", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "4410ea83-4566-4c60-99ff-d1b5f30ec440"}], "security_groups": [{"name": "tempest-securitygroup--1656161161"}], "key_name": "tempest-keypair-60832592", "user_data": "}} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:26:53.929141 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.network.neutron [None req-5f0c8d41-8f83-496f-8812-6fec3daa5a0e tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] validate_networks() for [('4410ea83-4566-4c60-99ff-d1b5f30ec440', None, None, None, None, None)] {{(pid=117538) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 31 18:26:54.374875 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.virt.hardware [None req-5f0c8d41-8f83-496f-8812-6fec3daa5a0e tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Flavor limits 0:0:0 {{(pid=117538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 31 18:26:54.375291 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.virt.hardware [None req-5f0c8d41-8f83-496f-8812-6fec3daa5a0e tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Image limits 0:0:0 {{(pid=117538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 31 18:26:54.375753 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.virt.hardware [None req-5f0c8d41-8f83-496f-8812-6fec3daa5a0e tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Flavor pref 0:0:0 {{(pid=117538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 31 18:26:54.376181 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.virt.hardware [None req-5f0c8d41-8f83-496f-8812-6fec3daa5a0e tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Image pref 0:0:0 {{(pid=117538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 31 18:26:54.376581 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.virt.hardware [None req-5f0c8d41-8f83-496f-8812-6fec3daa5a0e tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 31 18:26:54.385674 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-5f0c8d41-8f83-496f-8812-6fec3daa5a0e tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:26:54.386113 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-5f0c8d41-8f83-496f-8812-6fec3daa5a0e tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:26:54.386947 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-5f0c8d41-8f83-496f-8812-6fec3daa5a0e tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:26:54.387376 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-5f0c8d41-8f83-496f-8812-6fec3daa5a0e tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:26:54.404060 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.quota [None req-5f0c8d41-8f83-496f-8812-6fec3daa5a0e tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Getting quotas for project 87baab8d37b040efbfe030d17be30823. Resources: {'instances', 'ram', 'cores'} {{(pid=117538) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 31 18:26:54.407841 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.quota [None req-5f0c8d41-8f83-496f-8812-6fec3daa5a0e tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Getting quotas for user c1a075de217449d9a941a7bc3c4c99c3 and project 87baab8d37b040efbfe030d17be30823. Resources: {'instances', 'ram', 'cores'} {{(pid=117538) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 31 18:26:54.418258 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-5f0c8d41-8f83-496f-8812-6fec3daa5a0e tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Going to run 1 instances... {{(pid=117538) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 31 18:26:54.420511 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-5f0c8d41-8f83-496f-8812-6fec3daa5a0e tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 7c1ec735-055d-4f24-acec-a40cb9576c0d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6241b999-6f6d-4076-88bc-345fa7386256',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117538) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 31 18:26:54.573144 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-5f0c8d41-8f83-496f-8812-6fec3daa5a0e tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.749780 Mar 31 18:26:54.573792 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 472/931] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Mar 31 18:26:53 2022] POST /compute/v2.1/servers => generated 402 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 31 18:26:54.584401 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-223a86b4-08c3-4e02-8715-554c547a3e82 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:26:54.585006 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-223a86b4-08c3-4e02-8715-554c547a3e82 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 7c1ec735-055d-4f24-acec-a40cb9576c0d] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:26:54.638549 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-223a86b4-08c3-4e02-8715-554c547a3e82 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:26:54.646000 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-223a86b4-08c3-4e02-8715-554c547a3e82 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d" status: 200 len: 1235 microversion: 2.1 time: 0.066129 Mar 31 18:26:54.646565 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 460/932] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:26:54 2022] GET /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d => generated 1235 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:26:55.663225 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-f5cfa7ef-abb1-4a69-9948-8ad14d1c0e5e tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:26:55.663878 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-f5cfa7ef-abb1-4a69-9948-8ad14d1c0e5e tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 7c1ec735-055d-4f24-acec-a40cb9576c0d] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:26:55.671196 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f5cfa7ef-abb1-4a69-9948-8ad14d1c0e5e tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:26:55.671641 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f5cfa7ef-abb1-4a69-9948-8ad14d1c0e5e tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:26:55.672417 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f5cfa7ef-abb1-4a69-9948-8ad14d1c0e5e tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:26:55.672846 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f5cfa7ef-abb1-4a69-9948-8ad14d1c0e5e tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:26:55.732411 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-f5cfa7ef-abb1-4a69-9948-8ad14d1c0e5e tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:26:55.739759 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-f5cfa7ef-abb1-4a69-9948-8ad14d1c0e5e tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d" status: 200 len: 1239 microversion: 2.1 time: 0.081243 Mar 31 18:26:55.742811 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 473/933] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:26:55 2022] GET /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d => generated 1239 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:26:56.756010 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-0884d39e-e9bf-4ed5-8d80-0e85c787d119 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:26:56.756644 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-0884d39e-e9bf-4ed5-8d80-0e85c787d119 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 7c1ec735-055d-4f24-acec-a40cb9576c0d] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:26:56.762896 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0884d39e-e9bf-4ed5-8d80-0e85c787d119 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:26:56.763368 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0884d39e-e9bf-4ed5-8d80-0e85c787d119 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:26:56.764167 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0884d39e-e9bf-4ed5-8d80-0e85c787d119 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:26:56.764611 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0884d39e-e9bf-4ed5-8d80-0e85c787d119 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:26:56.827484 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-0884d39e-e9bf-4ed5-8d80-0e85c787d119 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:26:56.835558 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-0884d39e-e9bf-4ed5-8d80-0e85c787d119 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d" status: 200 len: 1287 microversion: 2.1 time: 0.083573 Mar 31 18:26:56.836386 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 461/934] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:26:56 2022] GET /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d => generated 1287 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:26:57.857168 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-87967dc7-1948-4dd3-8961-1f15c0f7d967 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:26:57.857772 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-87967dc7-1948-4dd3-8961-1f15c0f7d967 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 7c1ec735-055d-4f24-acec-a40cb9576c0d] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:26:57.864493 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-87967dc7-1948-4dd3-8961-1f15c0f7d967 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:26:57.865028 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-87967dc7-1948-4dd3-8961-1f15c0f7d967 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:26:57.865845 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-87967dc7-1948-4dd3-8961-1f15c0f7d967 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:26:57.866273 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-87967dc7-1948-4dd3-8961-1f15c0f7d967 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:26:58.108900 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-87967dc7-1948-4dd3-8961-1f15c0f7d967 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:26:58.117457 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-87967dc7-1948-4dd3-8961-1f15c0f7d967 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d" status: 200 len: 1361 microversion: 2.1 time: 0.264096 Mar 31 18:26:58.118121 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 474/935] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:26:57 2022] GET /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d => generated 1361 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:26:59.077389 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [req-afe2a494-0e96-4202-bbc5-de638603ae33 req-0b6b2db7-8130-434d-9db1-52aeabc6d17c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c1ec735-055d-4f24-acec-a40cb9576c0d", "tag": "1f4cdbaf-59bc-42f8-968b-9f65a74c2312"}]} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:26:59.096938 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-afe2a494-0e96-4202-bbc5-de638603ae33 req-0b6b2db7-8130-434d-9db1-52aeabc6d17c service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:26:59.097620 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-afe2a494-0e96-4202-bbc5-de638603ae33 req-0b6b2db7-8130-434d-9db1-52aeabc6d17c service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:26:59.110951 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.compute.server_external_events [req-afe2a494-0e96-4202-bbc5-de638603ae33 req-0b6b2db7-8130-434d-9db1-52aeabc6d17c service nova] Creating event network-changed:1f4cdbaf-59bc-42f8-968b-9f65a74c2312 for instance 7c1ec735-055d-4f24-acec-a40cb9576c0d on hv-cinder-maste Mar 31 18:26:59.116408 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [req-afe2a494-0e96-4202-bbc5-de638603ae33 req-0b6b2db7-8130-434d-9db1-52aeabc6d17c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043132 Mar 31 18:26:59.117205 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 462/936] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:26:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:26:59.134363 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-cf2e8367-3afe-46cc-b0b8-9a53d3d112f9 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:26:59.135036 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-cf2e8367-3afe-46cc-b0b8-9a53d3d112f9 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 7c1ec735-055d-4f24-acec-a40cb9576c0d] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:26:59.141618 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-cf2e8367-3afe-46cc-b0b8-9a53d3d112f9 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:26:59.142077 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-cf2e8367-3afe-46cc-b0b8-9a53d3d112f9 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:26:59.143128 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-cf2e8367-3afe-46cc-b0b8-9a53d3d112f9 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:26:59.143621 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-cf2e8367-3afe-46cc-b0b8-9a53d3d112f9 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:26:59.383587 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-cf2e8367-3afe-46cc-b0b8-9a53d3d112f9 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:26:59.391008 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-cf2e8367-3afe-46cc-b0b8-9a53d3d112f9 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d" status: 200 len: 1361 microversion: 2.1 time: 0.260485 Mar 31 18:26:59.391612 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 475/937] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:26:59 2022] GET /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d => generated 1361 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:27:00.408418 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-0600cc6b-6232-4a31-afed-961481593c85 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:27:00.409188 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-0600cc6b-6232-4a31-afed-961481593c85 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 7c1ec735-055d-4f24-acec-a40cb9576c0d] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:27:00.415929 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0600cc6b-6232-4a31-afed-961481593c85 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:00.416369 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0600cc6b-6232-4a31-afed-961481593c85 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:00.417124 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0600cc6b-6232-4a31-afed-961481593c85 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:00.417551 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0600cc6b-6232-4a31-afed-961481593c85 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:00.549195 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-0600cc6b-6232-4a31-afed-961481593c85 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:27:00.556895 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-0600cc6b-6232-4a31-afed-961481593c85 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d" status: 200 len: 1361 microversion: 2.1 time: 0.152767 Mar 31 18:27:00.557447 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 463/938] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:27:00 2022] GET /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d => generated 1361 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:27:01.090235 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-7d3413f6-ce69-435e-b08f-b0767a6c71c4 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:27:01.090782 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-7d3413f6-ce69-435e-b08f-b0767a6c71c4 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 8d43f77a-cb85-4276-9bed-686f306ea21a] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:27:01.097059 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-7d3413f6-ce69-435e-b08f-b0767a6c71c4 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:01.097506 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-7d3413f6-ce69-435e-b08f-b0767a6c71c4 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:01.098587 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-7d3413f6-ce69-435e-b08f-b0767a6c71c4 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:01.099037 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-7d3413f6-ce69-435e-b08f-b0767a6c71c4 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:01.120959 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-7d3413f6-ce69-435e-b08f-b0767a6c71c4 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a/ips" status: 200 len: 149 microversion: 2.1 time: 0.034431 Mar 31 18:27:01.121526 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 476/939] 10.222.0.58 () {58 vars in 1247 bytes} [Thu Mar 31 18:27:01 2022] GET /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a/ips => generated 149 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:27:01.574322 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-f2fed834-8b43-49b4-b75d-ec35ac004e4a tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:27:01.575001 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-f2fed834-8b43-49b4-b75d-ec35ac004e4a tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 7c1ec735-055d-4f24-acec-a40cb9576c0d] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:27:01.580919 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-f2fed834-8b43-49b4-b75d-ec35ac004e4a tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:01.581364 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-f2fed834-8b43-49b4-b75d-ec35ac004e4a tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:01.582139 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-f2fed834-8b43-49b4-b75d-ec35ac004e4a tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:01.582693 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-f2fed834-8b43-49b4-b75d-ec35ac004e4a tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:01.719114 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-f2fed834-8b43-49b4-b75d-ec35ac004e4a tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:27:01.727294 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-f2fed834-8b43-49b4-b75d-ec35ac004e4a tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d" status: 200 len: 1361 microversion: 2.1 time: 0.156811 Mar 31 18:27:01.727847 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 464/940] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:27:01 2022] GET /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:27:02.744500 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-96b411cc-b292-4992-ab02-d93b9215e57d tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:27:02.745128 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-96b411cc-b292-4992-ab02-d93b9215e57d tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 7c1ec735-055d-4f24-acec-a40cb9576c0d] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:27:02.751366 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-96b411cc-b292-4992-ab02-d93b9215e57d tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:02.751810 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-96b411cc-b292-4992-ab02-d93b9215e57d tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:02.752562 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-96b411cc-b292-4992-ab02-d93b9215e57d tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:02.752991 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-96b411cc-b292-4992-ab02-d93b9215e57d tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:02.892336 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-96b411cc-b292-4992-ab02-d93b9215e57d tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:27:02.900602 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-96b411cc-b292-4992-ab02-d93b9215e57d tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d" status: 200 len: 1361 microversion: 2.1 time: 0.159986 Mar 31 18:27:02.901173 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 477/941] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:27:02 2022] GET /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:27:03.917007 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-2b71eca7-da22-44ca-9ec4-17bd1946beb5 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:27:03.917616 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-2b71eca7-da22-44ca-9ec4-17bd1946beb5 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 7c1ec735-055d-4f24-acec-a40cb9576c0d] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:27:03.920017 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-0ef3efcc-8feb-4b1d-8c45-0b0147a69793 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c48f262-fa8d-4866-94e7-85a965b27f7f"}} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:27:03.921140 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-0ef3efcc-8feb-4b1d-8c45-0b0147a69793 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 8d43f77a-cb85-4276-9bed-686f306ea21a] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:27:03.923547 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-2b71eca7-da22-44ca-9ec4-17bd1946beb5 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:03.936190 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-2b71eca7-da22-44ca-9ec4-17bd1946beb5 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:03.936190 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-2b71eca7-da22-44ca-9ec4-17bd1946beb5 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:03.936190 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-2b71eca7-da22-44ca-9ec4-17bd1946beb5 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:03.936496 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-0ef3efcc-8feb-4b1d-8c45-0b0147a69793 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:03.936496 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-0ef3efcc-8feb-4b1d-8c45-0b0147a69793 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:03.936496 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-0ef3efcc-8feb-4b1d-8c45-0b0147a69793 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:03.936496 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-0ef3efcc-8feb-4b1d-8c45-0b0147a69793 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:04.074004 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-2b71eca7-da22-44ca-9ec4-17bd1946beb5 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:27:04.081307 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-2b71eca7-da22-44ca-9ec4-17bd1946beb5 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d" status: 200 len: 1361 microversion: 2.1 time: 0.168034 Mar 31 18:27:04.081882 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 465/942] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:27:03 2022] GET /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d => generated 1361 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:27:04.667129 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-0ef3efcc-8feb-4b1d-8c45-0b0147a69793 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "POST /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.750757 Mar 31 18:27:04.667764 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 478/943] 10.222.0.58 () {60 vars in 1322 bytes} [Thu Mar 31 18:27:03 2022] POST /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a/os-volume_attachments => generated 194 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 31 18:27:05.100148 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-9ec22a06-f246-412d-8f91-18120d695eef tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:27:05.100811 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-9ec22a06-f246-412d-8f91-18120d695eef tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 7c1ec735-055d-4f24-acec-a40cb9576c0d] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:27:05.106831 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9ec22a06-f246-412d-8f91-18120d695eef tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:05.107307 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9ec22a06-f246-412d-8f91-18120d695eef tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:05.108064 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9ec22a06-f246-412d-8f91-18120d695eef tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:05.108493 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9ec22a06-f246-412d-8f91-18120d695eef tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:05.246877 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-9ec22a06-f246-412d-8f91-18120d695eef tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:27:05.254027 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-9ec22a06-f246-412d-8f91-18120d695eef tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d" status: 200 len: 1361 microversion: 2.1 time: 0.158484 Mar 31 18:27:05.255348 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 466/944] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:27:05 2022] GET /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d => generated 1361 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:27:06.273561 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-c3663414-08ce-4323-aaaf-72a8d13a457f tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:27:06.274224 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-c3663414-08ce-4323-aaaf-72a8d13a457f tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 7c1ec735-055d-4f24-acec-a40cb9576c0d] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:27:06.280214 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c3663414-08ce-4323-aaaf-72a8d13a457f tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:06.280666 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c3663414-08ce-4323-aaaf-72a8d13a457f tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:06.281488 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c3663414-08ce-4323-aaaf-72a8d13a457f tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:06.281920 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c3663414-08ce-4323-aaaf-72a8d13a457f tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:06.379846 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [req-60a6d4be-330d-4810-be4b-8a1118763d3e req-fcdd0d95-ffca-4a33-b874-7b098a07b9c2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c1ec735-055d-4f24-acec-a40cb9576c0d", "name": "network-vif-plugged", "status": "completed", "tag": "1f4cdbaf-59bc-42f8-968b-9f65a74c2312"}]} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:27:06.388633 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-60a6d4be-330d-4810-be4b-8a1118763d3e req-fcdd0d95-ffca-4a33-b874-7b098a07b9c2 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:06.389142 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-60a6d4be-330d-4810-be4b-8a1118763d3e req-fcdd0d95-ffca-4a33-b874-7b098a07b9c2 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:06.400650 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.compute.server_external_events [req-60a6d4be-330d-4810-be4b-8a1118763d3e req-fcdd0d95-ffca-4a33-b874-7b098a07b9c2 service nova] Creating event network-vif-plugged:1f4cdbaf-59bc-42f8-968b-9f65a74c2312 for instance 7c1ec735-055d-4f24-acec-a40cb9576c0d on hv-cinder-maste Mar 31 18:27:06.405741 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [req-60a6d4be-330d-4810-be4b-8a1118763d3e req-fcdd0d95-ffca-4a33-b874-7b098a07b9c2 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030605 Mar 31 18:27:06.407329 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 467/945] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:27:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 31 18:27:06.420409 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-c3663414-08ce-4323-aaaf-72a8d13a457f tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:27:06.428697 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-c3663414-08ce-4323-aaaf-72a8d13a457f tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d" status: 200 len: 1361 microversion: 2.1 time: 0.160233 Mar 31 18:27:06.429262 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 479/946] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:27:06 2022] GET /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d => generated 1361 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:27:07.446289 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-b5dcc656-0ce3-447a-a80b-25785f58a975 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:27:07.446937 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-b5dcc656-0ce3-447a-a80b-25785f58a975 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 7c1ec735-055d-4f24-acec-a40cb9576c0d] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:27:07.453073 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b5dcc656-0ce3-447a-a80b-25785f58a975 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:07.453515 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b5dcc656-0ce3-447a-a80b-25785f58a975 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:07.454267 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b5dcc656-0ce3-447a-a80b-25785f58a975 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:07.454721 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b5dcc656-0ce3-447a-a80b-25785f58a975 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:07.586043 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-b5dcc656-0ce3-447a-a80b-25785f58a975 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:27:07.593126 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-b5dcc656-0ce3-447a-a80b-25785f58a975 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d" status: 200 len: 1361 microversion: 2.1 time: 0.151814 Mar 31 18:27:07.593699 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 468/947] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:27:07 2022] GET /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d => generated 1361 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:27:08.610746 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-43a1c52e-1c6d-42a8-ae15-9243eac69984 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:27:08.611490 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-43a1c52e-1c6d-42a8-ae15-9243eac69984 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 7c1ec735-055d-4f24-acec-a40cb9576c0d] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:27:08.618157 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-43a1c52e-1c6d-42a8-ae15-9243eac69984 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:08.618598 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-43a1c52e-1c6d-42a8-ae15-9243eac69984 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:08.619396 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-43a1c52e-1c6d-42a8-ae15-9243eac69984 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:08.619864 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-43a1c52e-1c6d-42a8-ae15-9243eac69984 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:08.757254 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-43a1c52e-1c6d-42a8-ae15-9243eac69984 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:27:08.765430 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-43a1c52e-1c6d-42a8-ae15-9243eac69984 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d" status: 200 len: 1361 microversion: 2.1 time: 0.158608 Mar 31 18:27:08.765996 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 480/948] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:27:08 2022] GET /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d => generated 1361 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:27:09.783499 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-accbb4d8-c8c9-43a6-9333-91ed3cb5b6fe tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:27:09.784164 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-accbb4d8-c8c9-43a6-9333-91ed3cb5b6fe tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 7c1ec735-055d-4f24-acec-a40cb9576c0d] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:27:09.790570 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-accbb4d8-c8c9-43a6-9333-91ed3cb5b6fe tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:09.791039 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-accbb4d8-c8c9-43a6-9333-91ed3cb5b6fe tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:09.791791 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-accbb4d8-c8c9-43a6-9333-91ed3cb5b6fe tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:09.792214 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-accbb4d8-c8c9-43a6-9333-91ed3cb5b6fe tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:09.928954 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-accbb4d8-c8c9-43a6-9333-91ed3cb5b6fe tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:27:09.936522 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-accbb4d8-c8c9-43a6-9333-91ed3cb5b6fe tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d" status: 200 len: 1547 microversion: 2.1 time: 0.156824 Mar 31 18:27:09.937093 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 469/949] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:27:09 2022] GET /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d => generated 1547 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:27:09.953007 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-7513eb77-0025-48c2-ba33-bdd48896d76b tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:27:09.953497 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-7513eb77-0025-48c2-ba33-bdd48896d76b tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 7c1ec735-055d-4f24-acec-a40cb9576c0d] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:27:09.960545 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-7513eb77-0025-48c2-ba33-bdd48896d76b tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:09.961023 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-7513eb77-0025-48c2-ba33-bdd48896d76b tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:09.961861 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-7513eb77-0025-48c2-ba33-bdd48896d76b tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:09.962295 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-7513eb77-0025-48c2-ba33-bdd48896d76b tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:10.061555 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-7513eb77-0025-48c2-ba33-bdd48896d76b tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.112549 Mar 31 18:27:10.062342 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 481/950] 10.222.0.58 () {58 vars in 1274 bytes} [Thu Mar 31 18:27:09 2022] GET /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d/os-interface => generated 284 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:27:11.415042 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [req-db1f9046-f10a-4c86-a543-af8f32a5c3c8 req-a87019e3-7543-476b-95f9-1f1c5229e0cd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7c1ec735-055d-4f24-acec-a40cb9576c0d", "tag": "1f4cdbaf-59bc-42f8-968b-9f65a74c2312"}]} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:27:11.422995 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-db1f9046-f10a-4c86-a543-af8f32a5c3c8 req-a87019e3-7543-476b-95f9-1f1c5229e0cd service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:11.423432 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-db1f9046-f10a-4c86-a543-af8f32a5c3c8 req-a87019e3-7543-476b-95f9-1f1c5229e0cd service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:11.434920 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.compute.server_external_events [req-db1f9046-f10a-4c86-a543-af8f32a5c3c8 req-a87019e3-7543-476b-95f9-1f1c5229e0cd service nova] Creating event network-changed:1f4cdbaf-59bc-42f8-968b-9f65a74c2312 for instance 7c1ec735-055d-4f24-acec-a40cb9576c0d on hv-cinder-maste Mar 31 18:27:11.439650 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [req-db1f9046-f10a-4c86-a543-af8f32a5c3c8 req-a87019e3-7543-476b-95f9-1f1c5229e0cd service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029105 Mar 31 18:27:11.440241 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 470/951] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:27:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:27:13.196095 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-c4cc652f-73b1-4bd2-b358-34249fe1b760 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Action: 'create', calling method: .version_select at 0x7fa4d443bf70>, body: {"keypair": {"name": "tempest-keypair-1955263039"}} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:27:13.210761 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.quota [None req-c4cc652f-73b1-4bd2-b358-34249fe1b760 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Getting quotas for project 7ae2325a87da4c5f8179a77fbd3d8748. Resources: {'key_pairs'} {{(pid=117538) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 31 18:27:13.214507 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.quota [None req-c4cc652f-73b1-4bd2-b358-34249fe1b760 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Getting quotas for user 211572ee7ab5422981422eaed6341657 and project 7ae2325a87da4c5f8179a77fbd3d8748. Resources: {'key_pairs'} {{(pid=117538) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 31 18:27:13.546860 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.quota [None req-c4cc652f-73b1-4bd2-b358-34249fe1b760 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Getting quotas for project 7ae2325a87da4c5f8179a77fbd3d8748. Resources: {'key_pairs'} {{(pid=117538) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 31 18:27:13.550401 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.quota [None req-c4cc652f-73b1-4bd2-b358-34249fe1b760 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Getting quotas for user 211572ee7ab5422981422eaed6341657 and project 7ae2325a87da4c5f8179a77fbd3d8748. Resources: {'key_pairs'} {{(pid=117538) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 31 18:27:13.562867 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-c4cc652f-73b1-4bd2-b358-34249fe1b760 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 2301 microversion: 2.1 time: 0.371696 Mar 31 18:27:13.563453 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 482/952] 10.222.0.58 () {60 vars in 1157 bytes} [Thu Mar 31 18:27:13 2022] POST /compute/v2.1/os-keypairs => generated 2301 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:27:15.644522 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-01f125c0-3472-4f2c-8483-ebf18a801564 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1386837143", "imageRef": "6241b999-6f6d-4076-88bc-345fa7386256", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "48b6e4a0-767f-4f89-81e1-af0f127e9429"}], "security_groups": [{"name": "tempest-securitygroup--178598986"}], "key_name": "tempest-keypair-1955263039", "user_data": "}} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:27:15.741440 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.network.neutron [None req-01f125c0-3472-4f2c-8483-ebf18a801564 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] validate_networks() for [('48b6e4a0-767f-4f89-81e1-af0f127e9429', None, None, None, None, None)] {{(pid=117539) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 31 18:27:16.374701 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.virt.hardware [None req-01f125c0-3472-4f2c-8483-ebf18a801564 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Flavor limits 0:0:0 {{(pid=117539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 31 18:27:16.375121 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.virt.hardware [None req-01f125c0-3472-4f2c-8483-ebf18a801564 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Image limits 0:0:0 {{(pid=117539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 31 18:27:16.375589 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.virt.hardware [None req-01f125c0-3472-4f2c-8483-ebf18a801564 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Flavor pref 0:0:0 {{(pid=117539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 31 18:27:16.375991 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.virt.hardware [None req-01f125c0-3472-4f2c-8483-ebf18a801564 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Image pref 0:0:0 {{(pid=117539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 31 18:27:16.376395 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.virt.hardware [None req-01f125c0-3472-4f2c-8483-ebf18a801564 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 31 18:27:16.386495 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-01f125c0-3472-4f2c-8483-ebf18a801564 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:16.386965 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-01f125c0-3472-4f2c-8483-ebf18a801564 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:16.387757 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-01f125c0-3472-4f2c-8483-ebf18a801564 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:16.388189 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-01f125c0-3472-4f2c-8483-ebf18a801564 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:16.405026 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.quota [None req-01f125c0-3472-4f2c-8483-ebf18a801564 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Getting quotas for project 7ae2325a87da4c5f8179a77fbd3d8748. Resources: {'instances', 'ram', 'cores'} {{(pid=117539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 31 18:27:16.408798 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.quota [None req-01f125c0-3472-4f2c-8483-ebf18a801564 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Getting quotas for user 211572ee7ab5422981422eaed6341657 and project 7ae2325a87da4c5f8179a77fbd3d8748. Resources: {'instances', 'ram', 'cores'} {{(pid=117539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 31 18:27:16.419514 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-01f125c0-3472-4f2c-8483-ebf18a801564 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Going to run 1 instances... {{(pid=117539) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 31 18:27:16.421859 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-01f125c0-3472-4f2c-8483-ebf18a801564 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 99e5e8ac-ddfc-4450-8900-3d66a7ac8910] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6241b999-6f6d-4076-88bc-345fa7386256',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 31 18:27:16.568096 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-01f125c0-3472-4f2c-8483-ebf18a801564 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.928059 Mar 31 18:27:16.568663 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 471/953] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Mar 31 18:27:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 930 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 31 18:27:16.579243 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-f204d681-0577-4b0a-b65f-e6e30c13c144 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:27:16.579905 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-f204d681-0577-4b0a-b65f-e6e30c13c144 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 99e5e8ac-ddfc-4450-8900-3d66a7ac8910] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:27:16.632508 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-f204d681-0577-4b0a-b65f-e6e30c13c144 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:27:16.639071 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-f204d681-0577-4b0a-b65f-e6e30c13c144 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/99e5e8ac-ddfc-4450-8900-3d66a7ac8910" status: 200 len: 1242 microversion: 2.1 time: 0.064062 Mar 31 18:27:16.639657 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 483/954] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:27:16 2022] GET /compute/v2.1/servers/99e5e8ac-ddfc-4450-8900-3d66a7ac8910 => generated 1242 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:27:17.655162 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-a4fe9ef9-38ba-4122-a029-83b6f4b814ec tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:27:17.655715 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-a4fe9ef9-38ba-4122-a029-83b6f4b814ec tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 99e5e8ac-ddfc-4450-8900-3d66a7ac8910] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:27:17.662433 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a4fe9ef9-38ba-4122-a029-83b6f4b814ec tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:17.662893 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a4fe9ef9-38ba-4122-a029-83b6f4b814ec tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:17.663643 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a4fe9ef9-38ba-4122-a029-83b6f4b814ec tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:17.664067 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a4fe9ef9-38ba-4122-a029-83b6f4b814ec tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:17.724852 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-a4fe9ef9-38ba-4122-a029-83b6f4b814ec tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:27:17.732278 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-a4fe9ef9-38ba-4122-a029-83b6f4b814ec tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/99e5e8ac-ddfc-4450-8900-3d66a7ac8910" status: 200 len: 1246 microversion: 2.1 time: 0.081087 Mar 31 18:27:17.732853 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 472/955] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:27:17 2022] GET /compute/v2.1/servers/99e5e8ac-ddfc-4450-8900-3d66a7ac8910 => generated 1246 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:27:18.749542 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-3fb6111c-2eb9-4bed-87cb-4b35078ea476 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:27:18.750198 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-3fb6111c-2eb9-4bed-87cb-4b35078ea476 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 99e5e8ac-ddfc-4450-8900-3d66a7ac8910] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:27:18.757285 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3fb6111c-2eb9-4bed-87cb-4b35078ea476 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:18.757737 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3fb6111c-2eb9-4bed-87cb-4b35078ea476 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:18.758508 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3fb6111c-2eb9-4bed-87cb-4b35078ea476 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:18.758965 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3fb6111c-2eb9-4bed-87cb-4b35078ea476 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:18.839100 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-3fb6111c-2eb9-4bed-87cb-4b35078ea476 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:27:18.847221 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-3fb6111c-2eb9-4bed-87cb-4b35078ea476 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/99e5e8ac-ddfc-4450-8900-3d66a7ac8910" status: 200 len: 1302 microversion: 2.1 time: 0.101561 Mar 31 18:27:18.847802 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 484/956] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:27:18 2022] GET /compute/v2.1/servers/99e5e8ac-ddfc-4450-8900-3d66a7ac8910 => generated 1302 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:27:19.864857 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-035eaa19-0147-4ac0-a43a-25c8841e689d tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:27:19.865452 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-035eaa19-0147-4ac0-a43a-25c8841e689d tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 99e5e8ac-ddfc-4450-8900-3d66a7ac8910] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:27:19.871199 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-035eaa19-0147-4ac0-a43a-25c8841e689d tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:19.871643 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-035eaa19-0147-4ac0-a43a-25c8841e689d tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:19.872404 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-035eaa19-0147-4ac0-a43a-25c8841e689d tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:19.872827 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-035eaa19-0147-4ac0-a43a-25c8841e689d tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:20.005080 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-035eaa19-0147-4ac0-a43a-25c8841e689d tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:27:20.012321 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-035eaa19-0147-4ac0-a43a-25c8841e689d tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/99e5e8ac-ddfc-4450-8900-3d66a7ac8910" status: 200 len: 1367 microversion: 2.1 time: 0.151402 Mar 31 18:27:20.012866 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 473/957] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:27:19 2022] GET /compute/v2.1/servers/99e5e8ac-ddfc-4450-8900-3d66a7ac8910 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:27:20.394603 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [req-83e46a17-436f-46bc-9ee2-2c37e835623c req-bbced805-1479-4ce5-8655-1b6fdd462e65 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99e5e8ac-ddfc-4450-8900-3d66a7ac8910", "tag": "d53f10e2-e3b6-45ca-951d-3dfc9e640379"}]} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:27:20.409829 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-83e46a17-436f-46bc-9ee2-2c37e835623c req-bbced805-1479-4ce5-8655-1b6fdd462e65 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:20.410716 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-83e46a17-436f-46bc-9ee2-2c37e835623c req-bbced805-1479-4ce5-8655-1b6fdd462e65 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:20.431197 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.compute.server_external_events [req-83e46a17-436f-46bc-9ee2-2c37e835623c req-bbced805-1479-4ce5-8655-1b6fdd462e65 service nova] Creating event network-changed:d53f10e2-e3b6-45ca-951d-3dfc9e640379 for instance 99e5e8ac-ddfc-4450-8900-3d66a7ac8910 on hv-cinder-maste Mar 31 18:27:20.431197 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [req-83e46a17-436f-46bc-9ee2-2c37e835623c req-bbced805-1479-4ce5-8655-1b6fdd462e65 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037448 Mar 31 18:27:20.431197 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 485/958] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:27:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:27:21.029802 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-66bb1471-c4a8-4064-834e-371360955cb3 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:27:21.030412 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-66bb1471-c4a8-4064-834e-371360955cb3 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 99e5e8ac-ddfc-4450-8900-3d66a7ac8910] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:27:21.037394 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-66bb1471-c4a8-4064-834e-371360955cb3 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:21.037836 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-66bb1471-c4a8-4064-834e-371360955cb3 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:21.038623 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-66bb1471-c4a8-4064-834e-371360955cb3 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:21.039056 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-66bb1471-c4a8-4064-834e-371360955cb3 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:21.179343 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-66bb1471-c4a8-4064-834e-371360955cb3 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:27:21.186837 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-66bb1471-c4a8-4064-834e-371360955cb3 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/99e5e8ac-ddfc-4450-8900-3d66a7ac8910" status: 200 len: 1367 microversion: 2.1 time: 0.160879 Mar 31 18:27:21.187409 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 474/959] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:27:21 2022] GET /compute/v2.1/servers/99e5e8ac-ddfc-4450-8900-3d66a7ac8910 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:27:22.204548 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-944193cf-27a0-42aa-8cd8-e2cc8ed6a161 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:27:22.205262 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-944193cf-27a0-42aa-8cd8-e2cc8ed6a161 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 99e5e8ac-ddfc-4450-8900-3d66a7ac8910] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:27:22.211416 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-944193cf-27a0-42aa-8cd8-e2cc8ed6a161 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:22.211857 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-944193cf-27a0-42aa-8cd8-e2cc8ed6a161 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:22.212603 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-944193cf-27a0-42aa-8cd8-e2cc8ed6a161 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:22.213034 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-944193cf-27a0-42aa-8cd8-e2cc8ed6a161 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:22.348833 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-944193cf-27a0-42aa-8cd8-e2cc8ed6a161 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:27:22.355968 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-944193cf-27a0-42aa-8cd8-e2cc8ed6a161 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/99e5e8ac-ddfc-4450-8900-3d66a7ac8910" status: 200 len: 1367 microversion: 2.1 time: 0.156095 Mar 31 18:27:22.356528 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 486/960] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:27:22 2022] GET /compute/v2.1/servers/99e5e8ac-ddfc-4450-8900-3d66a7ac8910 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:27:23.372909 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-baa5304c-f276-4e1f-bcc4-cd1e42d24443 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:27:23.373445 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-baa5304c-f276-4e1f-bcc4-cd1e42d24443 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 99e5e8ac-ddfc-4450-8900-3d66a7ac8910] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:27:23.380045 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-baa5304c-f276-4e1f-bcc4-cd1e42d24443 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:23.380636 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-baa5304c-f276-4e1f-bcc4-cd1e42d24443 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:23.381395 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-baa5304c-f276-4e1f-bcc4-cd1e42d24443 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:23.381825 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-baa5304c-f276-4e1f-bcc4-cd1e42d24443 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:23.513632 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-baa5304c-f276-4e1f-bcc4-cd1e42d24443 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:27:23.521090 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-baa5304c-f276-4e1f-bcc4-cd1e42d24443 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/99e5e8ac-ddfc-4450-8900-3d66a7ac8910" status: 200 len: 1367 microversion: 2.1 time: 0.152173 Mar 31 18:27:23.521648 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 475/961] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:27:23 2022] GET /compute/v2.1/servers/99e5e8ac-ddfc-4450-8900-3d66a7ac8910 => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:27:24.537835 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-45c4659e-ab30-4e0e-8ebf-72f66c1021ac tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:27:24.538437 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-45c4659e-ab30-4e0e-8ebf-72f66c1021ac tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 99e5e8ac-ddfc-4450-8900-3d66a7ac8910] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:27:24.544724 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-45c4659e-ab30-4e0e-8ebf-72f66c1021ac tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:24.545168 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-45c4659e-ab30-4e0e-8ebf-72f66c1021ac tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:24.545925 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-45c4659e-ab30-4e0e-8ebf-72f66c1021ac tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:24.546383 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-45c4659e-ab30-4e0e-8ebf-72f66c1021ac tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:24.680646 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-45c4659e-ab30-4e0e-8ebf-72f66c1021ac tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:27:24.687920 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-45c4659e-ab30-4e0e-8ebf-72f66c1021ac tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/99e5e8ac-ddfc-4450-8900-3d66a7ac8910" status: 200 len: 1367 microversion: 2.1 time: 0.154584 Mar 31 18:27:24.688581 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 487/962] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:27:24 2022] GET /compute/v2.1/servers/99e5e8ac-ddfc-4450-8900-3d66a7ac8910 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:27:25.705817 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-425c600a-040a-487f-b36a-d0c263f8a09c tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:27:25.706420 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-425c600a-040a-487f-b36a-d0c263f8a09c tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 99e5e8ac-ddfc-4450-8900-3d66a7ac8910] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:27:25.712489 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-425c600a-040a-487f-b36a-d0c263f8a09c tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:25.712930 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-425c600a-040a-487f-b36a-d0c263f8a09c tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:25.713680 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-425c600a-040a-487f-b36a-d0c263f8a09c tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:25.714108 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-425c600a-040a-487f-b36a-d0c263f8a09c tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:25.846574 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-425c600a-040a-487f-b36a-d0c263f8a09c tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:27:25.854535 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-425c600a-040a-487f-b36a-d0c263f8a09c tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/99e5e8ac-ddfc-4450-8900-3d66a7ac8910" status: 200 len: 1367 microversion: 2.1 time: 0.152600 Mar 31 18:27:25.855130 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 476/963] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:27:25 2022] GET /compute/v2.1/servers/99e5e8ac-ddfc-4450-8900-3d66a7ac8910 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:27:26.340802 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [req-5db75b1d-0371-4889-8891-18169fb0c242 req-20140fdd-a9f4-4e7e-8c7b-f14e3395becc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99e5e8ac-ddfc-4450-8900-3d66a7ac8910", "name": "network-vif-plugged", "status": "completed", "tag": "d53f10e2-e3b6-45ca-951d-3dfc9e640379"}]} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:27:26.350317 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-5db75b1d-0371-4889-8891-18169fb0c242 req-20140fdd-a9f4-4e7e-8c7b-f14e3395becc service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:26.350572 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-5db75b1d-0371-4889-8891-18169fb0c242 req-20140fdd-a9f4-4e7e-8c7b-f14e3395becc service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:26.361429 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.compute.server_external_events [req-5db75b1d-0371-4889-8891-18169fb0c242 req-20140fdd-a9f4-4e7e-8c7b-f14e3395becc service nova] Creating event network-vif-plugged:d53f10e2-e3b6-45ca-951d-3dfc9e640379 for instance 99e5e8ac-ddfc-4450-8900-3d66a7ac8910 on hv-cinder-maste Mar 31 18:27:26.366898 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [req-5db75b1d-0371-4889-8891-18169fb0c242 req-20140fdd-a9f4-4e7e-8c7b-f14e3395becc service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029841 Mar 31 18:27:26.367487 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 488/964] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:27:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:27:26.871686 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-11425cf7-87f1-4012-a6bd-056cb8791a4f tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:27:26.872284 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-11425cf7-87f1-4012-a6bd-056cb8791a4f tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 99e5e8ac-ddfc-4450-8900-3d66a7ac8910] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:27:26.878191 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-11425cf7-87f1-4012-a6bd-056cb8791a4f tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:26.878656 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-11425cf7-87f1-4012-a6bd-056cb8791a4f tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:26.880174 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-11425cf7-87f1-4012-a6bd-056cb8791a4f tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:26.880601 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-11425cf7-87f1-4012-a6bd-056cb8791a4f tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:27.017991 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-11425cf7-87f1-4012-a6bd-056cb8791a4f tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:27:27.025982 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-11425cf7-87f1-4012-a6bd-056cb8791a4f tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/99e5e8ac-ddfc-4450-8900-3d66a7ac8910" status: 200 len: 1367 microversion: 2.1 time: 0.158143 Mar 31 18:27:27.026547 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 477/965] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:27:26 2022] GET /compute/v2.1/servers/99e5e8ac-ddfc-4450-8900-3d66a7ac8910 => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:27:28.044159 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-a9c3cf5f-084d-451d-89c8-f151147bec1a tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:27:28.044871 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-a9c3cf5f-084d-451d-89c8-f151147bec1a tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 99e5e8ac-ddfc-4450-8900-3d66a7ac8910] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:27:28.051167 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a9c3cf5f-084d-451d-89c8-f151147bec1a tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:28.051638 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a9c3cf5f-084d-451d-89c8-f151147bec1a tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:28.052386 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a9c3cf5f-084d-451d-89c8-f151147bec1a tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:28.052840 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a9c3cf5f-084d-451d-89c8-f151147bec1a tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:28.218097 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-a9c3cf5f-084d-451d-89c8-f151147bec1a tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:27:28.225978 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-a9c3cf5f-084d-451d-89c8-f151147bec1a tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/99e5e8ac-ddfc-4450-8900-3d66a7ac8910" status: 200 len: 1367 microversion: 2.1 time: 0.186586 Mar 31 18:27:28.226595 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 489/966] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:27:28 2022] GET /compute/v2.1/servers/99e5e8ac-ddfc-4450-8900-3d66a7ac8910 => generated 1367 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:27:29.243175 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-32f2a553-ec06-4bf6-8973-82f853cba483 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:27:29.243795 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-32f2a553-ec06-4bf6-8973-82f853cba483 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 99e5e8ac-ddfc-4450-8900-3d66a7ac8910] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:27:29.251104 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-32f2a553-ec06-4bf6-8973-82f853cba483 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:29.251547 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-32f2a553-ec06-4bf6-8973-82f853cba483 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:29.252326 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-32f2a553-ec06-4bf6-8973-82f853cba483 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:29.252757 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-32f2a553-ec06-4bf6-8973-82f853cba483 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:29.385151 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-32f2a553-ec06-4bf6-8973-82f853cba483 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:27:29.392613 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-32f2a553-ec06-4bf6-8973-82f853cba483 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/99e5e8ac-ddfc-4450-8900-3d66a7ac8910" status: 200 len: 1557 microversion: 2.1 time: 0.153892 Mar 31 18:27:29.393180 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 478/967] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:27:29 2022] GET /compute/v2.1/servers/99e5e8ac-ddfc-4450-8900-3d66a7ac8910 => generated 1557 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:27:29.409870 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-d091555e-9e91-4526-9693-f8cea3d8d887 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:27:29.410381 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-d091555e-9e91-4526-9693-f8cea3d8d887 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 99e5e8ac-ddfc-4450-8900-3d66a7ac8910] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:27:29.416776 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-d091555e-9e91-4526-9693-f8cea3d8d887 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:29.417217 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-d091555e-9e91-4526-9693-f8cea3d8d887 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:29.417980 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-d091555e-9e91-4526-9693-f8cea3d8d887 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:29.418414 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-d091555e-9e91-4526-9693-f8cea3d8d887 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:29.505257 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-d091555e-9e91-4526-9693-f8cea3d8d887 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/99e5e8ac-ddfc-4450-8900-3d66a7ac8910/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099516 Mar 31 18:27:29.505940 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 490/968] 10.222.0.58 () {58 vars in 1274 bytes} [Thu Mar 31 18:27:29 2022] GET /compute/v2.1/servers/99e5e8ac-ddfc-4450-8900-3d66a7ac8910/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:27:30.545307 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [req-5aabf5d1-3b99-401e-af08-35e4a8cf139d req-d40f0550-2bd8-496d-b129-c4159b41ca1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "99e5e8ac-ddfc-4450-8900-3d66a7ac8910", "tag": "d53f10e2-e3b6-45ca-951d-3dfc9e640379"}]} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:27:30.554853 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-5aabf5d1-3b99-401e-af08-35e4a8cf139d req-d40f0550-2bd8-496d-b129-c4159b41ca1c service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:30.555297 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-5aabf5d1-3b99-401e-af08-35e4a8cf139d req-d40f0550-2bd8-496d-b129-c4159b41ca1c service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:30.566626 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.compute.server_external_events [req-5aabf5d1-3b99-401e-af08-35e4a8cf139d req-d40f0550-2bd8-496d-b129-c4159b41ca1c service nova] Creating event network-changed:d53f10e2-e3b6-45ca-951d-3dfc9e640379 for instance 99e5e8ac-ddfc-4450-8900-3d66a7ac8910 on hv-cinder-maste Mar 31 18:27:30.572211 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [req-5aabf5d1-3b99-401e-af08-35e4a8cf139d req-d40f0550-2bd8-496d-b129-c4159b41ca1c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031458 Mar 31 18:27:30.572881 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 479/969] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:27:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:27:55.958238 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-4b860593-e089-4b79-a9e3-364e6faebe1b tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:27:55.958805 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-4b860593-e089-4b79-a9e3-364e6faebe1b tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: ef0f516d-f8cb-4c78-8e19-b5d530c90e68] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:27:55.960291 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [req-b2239ba4-bea9-4a1f-b24d-102ee0c458cf req-1fc8747e-b1dd-4588-ae08-3e62946be238 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ef0f516d-f8cb-4c78-8e19-b5d530c90e68", "tag": "adbd679c-b2bc-4261-80ec-b13d349ff692"}]} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:27:55.966003 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4b860593-e089-4b79-a9e3-364e6faebe1b tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:55.966539 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4b860593-e089-4b79-a9e3-364e6faebe1b tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:55.967412 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4b860593-e089-4b79-a9e3-364e6faebe1b tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:55.967908 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4b860593-e089-4b79-a9e3-364e6faebe1b tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:55.969224 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-b2239ba4-bea9-4a1f-b24d-102ee0c458cf req-1fc8747e-b1dd-4588-ae08-3e62946be238 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:55.969660 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-b2239ba4-bea9-4a1f-b24d-102ee0c458cf req-1fc8747e-b1dd-4588-ae08-3e62946be238 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:55.980954 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.compute.server_external_events [req-b2239ba4-bea9-4a1f-b24d-102ee0c458cf req-1fc8747e-b1dd-4588-ae08-3e62946be238 service nova] Creating event network-changed:adbd679c-b2bc-4261-80ec-b13d349ff692 for instance ef0f516d-f8cb-4c78-8e19-b5d530c90e68 on hv-cinder-maste Mar 31 18:27:55.986107 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [req-b2239ba4-bea9-4a1f-b24d-102ee0c458cf req-1fc8747e-b1dd-4588-ae08-3e62946be238 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029987 Mar 31 18:27:55.989585 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 480/970] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:27:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 31 18:27:55.994344 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-4b860593-e089-4b79-a9e3-364e6faebe1b tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: ef0f516d-f8cb-4c78-8e19-b5d530c90e68] Going to try to terminate instance {{(pid=117538) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 31 18:27:56.331408 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-4b860593-e089-4b79-a9e3-364e6faebe1b tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ef0f516d-f8cb-4c78-8e19-b5d530c90e68" status: 204 len: 0 microversion: 2.1 time: 0.377539 Mar 31 18:27:56.336662 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 491/971] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Mar 31 18:27:55 2022] DELETE /compute/v2.1/servers/ef0f516d-f8cb-4c78-8e19-b5d530c90e68 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Mar 31 18:27:56.341970 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-a907bae4-61e6-49b9-b2ac-14513001ee23 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:27:56.342733 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-a907bae4-61e6-49b9-b2ac-14513001ee23 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: ef0f516d-f8cb-4c78-8e19-b5d530c90e68] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:27:56.348910 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a907bae4-61e6-49b9-b2ac-14513001ee23 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:56.349336 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a907bae4-61e6-49b9-b2ac-14513001ee23 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:56.350089 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a907bae4-61e6-49b9-b2ac-14513001ee23 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:56.350513 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a907bae4-61e6-49b9-b2ac-14513001ee23 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:56.500211 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-a907bae4-61e6-49b9-b2ac-14513001ee23 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:27:56.508024 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-a907bae4-61e6-49b9-b2ac-14513001ee23 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/ef0f516d-f8cb-4c78-8e19-b5d530c90e68" status: 200 len: 1575 microversion: 2.1 time: 0.170210 Mar 31 18:27:56.508829 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 481/972] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:27:56 2022] GET /compute/v2.1/servers/ef0f516d-f8cb-4c78-8e19-b5d530c90e68 => generated 1575 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:27:57.526904 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-4e7a8892-1e31-4e0a-87e4-70cb6eb0082c tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:27:57.527589 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-4e7a8892-1e31-4e0a-87e4-70cb6eb0082c tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: ef0f516d-f8cb-4c78-8e19-b5d530c90e68] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:27:57.533901 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4e7a8892-1e31-4e0a-87e4-70cb6eb0082c tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:57.534348 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4e7a8892-1e31-4e0a-87e4-70cb6eb0082c tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:57.535142 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4e7a8892-1e31-4e0a-87e4-70cb6eb0082c tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:57.535570 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4e7a8892-1e31-4e0a-87e4-70cb6eb0082c tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:57.671423 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-4e7a8892-1e31-4e0a-87e4-70cb6eb0082c tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:27:57.681006 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-4e7a8892-1e31-4e0a-87e4-70cb6eb0082c tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/ef0f516d-f8cb-4c78-8e19-b5d530c90e68" status: 200 len: 1457 microversion: 2.1 time: 0.158315 Mar 31 18:27:57.681937 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 492/973] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:27:57 2022] GET /compute/v2.1/servers/ef0f516d-f8cb-4c78-8e19-b5d530c90e68 => generated 1457 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:27:58.698463 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-4cc28ac4-b264-4d2c-ba39-d067306b63fa tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:27:58.699091 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-4cc28ac4-b264-4d2c-ba39-d067306b63fa tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: ef0f516d-f8cb-4c78-8e19-b5d530c90e68] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:27:58.704819 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-4cc28ac4-b264-4d2c-ba39-d067306b63fa tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:58.705251 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-4cc28ac4-b264-4d2c-ba39-d067306b63fa tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:58.706000 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-4cc28ac4-b264-4d2c-ba39-d067306b63fa tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:58.706421 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-4cc28ac4-b264-4d2c-ba39-d067306b63fa tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:58.839206 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-4cc28ac4-b264-4d2c-ba39-d067306b63fa tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:27:58.846623 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-4cc28ac4-b264-4d2c-ba39-d067306b63fa tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/ef0f516d-f8cb-4c78-8e19-b5d530c90e68" status: 200 len: 1457 microversion: 2.1 time: 0.152056 Mar 31 18:27:58.847199 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 482/974] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:27:58 2022] GET /compute/v2.1/servers/ef0f516d-f8cb-4c78-8e19-b5d530c90e68 => generated 1457 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:27:59.186816 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [req-2dd8d540-3606-41b0-a1f7-ea1cfc5b1fb6 req-b68b63f7-9eae-466b-9eba-dcaf2bf9675e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ef0f516d-f8cb-4c78-8e19-b5d530c90e68", "name": "network-vif-deleted", "tag": "adbd679c-b2bc-4261-80ec-b13d349ff692"}]} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:27:59.192853 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-2dd8d540-3606-41b0-a1f7-ea1cfc5b1fb6 req-b68b63f7-9eae-466b-9eba-dcaf2bf9675e service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:59.193292 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-2dd8d540-3606-41b0-a1f7-ea1cfc5b1fb6 req-b68b63f7-9eae-466b-9eba-dcaf2bf9675e service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:59.204124 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.compute.server_external_events [req-2dd8d540-3606-41b0-a1f7-ea1cfc5b1fb6 req-b68b63f7-9eae-466b-9eba-dcaf2bf9675e service nova] Creating event network-vif-deleted:adbd679c-b2bc-4261-80ec-b13d349ff692 for instance ef0f516d-f8cb-4c78-8e19-b5d530c90e68 on hv-cinder-maste Mar 31 18:27:59.208973 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [req-2dd8d540-3606-41b0-a1f7-ea1cfc5b1fb6 req-b68b63f7-9eae-466b-9eba-dcaf2bf9675e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.027915 Mar 31 18:27:59.209545 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 493/975] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:27:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:27:59.864574 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-c63e537d-e5c9-4215-b10a-3f3502c42309 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:27:59.865189 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-c63e537d-e5c9-4215-b10a-3f3502c42309 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: ef0f516d-f8cb-4c78-8e19-b5d530c90e68] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:27:59.871431 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c63e537d-e5c9-4215-b10a-3f3502c42309 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:59.871938 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c63e537d-e5c9-4215-b10a-3f3502c42309 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:59.872699 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c63e537d-e5c9-4215-b10a-3f3502c42309 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:59.873133 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c63e537d-e5c9-4215-b10a-3f3502c42309 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:59.903819 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c63e537d-e5c9-4215-b10a-3f3502c42309 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:27:59.904263 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c63e537d-e5c9-4215-b10a-3f3502c42309 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:27:59.904698 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.objects.instance [None req-c63e537d-e5c9-4215-b10a-3f3502c42309 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lazy-loading 'fault' on Instance uuid ef0f516d-f8cb-4c78-8e19-b5d530c90e68 {{(pid=117539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 31 18:27:59.948555 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-c63e537d-e5c9-4215-b10a-3f3502c42309 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:27:59.956547 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-c63e537d-e5c9-4215-b10a-3f3502c42309 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/ef0f516d-f8cb-4c78-8e19-b5d530c90e68" status: 200 len: 1229 microversion: 2.1 time: 0.095868 Mar 31 18:27:59.957182 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 483/976] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:27:59 2022] GET /compute/v2.1/servers/ef0f516d-f8cb-4c78-8e19-b5d530c90e68 => generated 1229 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:28:00.975961 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-61898b48-47de-4487-b105-dab169336046 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:28:00.977199 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-61898b48-47de-4487-b105-dab169336046 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: ef0f516d-f8cb-4c78-8e19-b5d530c90e68] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:28:00.983530 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-61898b48-47de-4487-b105-dab169336046 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:28:00.984010 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-61898b48-47de-4487-b105-dab169336046 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:28:00.984983 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-61898b48-47de-4487-b105-dab169336046 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:28:00.985422 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-61898b48-47de-4487-b105-dab169336046 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:28:00.998951 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.wsgi [None req-61898b48-47de-4487-b105-dab169336046 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] HTTP exception thrown: Instance ef0f516d-f8cb-4c78-8e19-b5d530c90e68 could not be found. Mar 31 18:28:00.999529 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-61898b48-47de-4487-b105-dab169336046 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Returning 404 to user: Instance ef0f516d-f8cb-4c78-8e19-b5d530c90e68 could not be found. {{(pid=117538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:28:01.000332 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-61898b48-47de-4487-b105-dab169336046 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/ef0f516d-f8cb-4c78-8e19-b5d530c90e68" status: 404 len: 111 microversion: 2.1 time: 0.029474 Mar 31 18:28:01.000856 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 494/977] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:28:00 2022] GET /compute/v2.1/servers/ef0f516d-f8cb-4c78-8e19-b5d530c90e68 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 31 18:28:04.430219 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-3ea63e29-60da-4911-aace-9110c965b180 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:28:04.430219 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-3ea63e29-60da-4911-aace-9110c965b180 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: 635a0e04-c990-4a66-81ed-ab572007484b] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:28:04.430948 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [req-bd6bd71b-4dae-4315-8900-a993f5694d3b req-50b20aac-ac6b-407f-a4da-5b3c2d75e136 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "635a0e04-c990-4a66-81ed-ab572007484b", "tag": "8009d02e-5d59-48da-9d8c-071ba781cd76"}]} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:28:04.436291 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3ea63e29-60da-4911-aace-9110c965b180 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:28:04.436855 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3ea63e29-60da-4911-aace-9110c965b180 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:28:04.437633 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3ea63e29-60da-4911-aace-9110c965b180 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:28:04.438070 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3ea63e29-60da-4911-aace-9110c965b180 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:28:04.439159 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-bd6bd71b-4dae-4315-8900-a993f5694d3b req-50b20aac-ac6b-407f-a4da-5b3c2d75e136 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:28:04.439588 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-bd6bd71b-4dae-4315-8900-a993f5694d3b req-50b20aac-ac6b-407f-a4da-5b3c2d75e136 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:28:04.450862 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.compute.server_external_events [req-bd6bd71b-4dae-4315-8900-a993f5694d3b req-50b20aac-ac6b-407f-a4da-5b3c2d75e136 service nova] Creating event network-changed:8009d02e-5d59-48da-9d8c-071ba781cd76 for instance 635a0e04-c990-4a66-81ed-ab572007484b on hv-cinder-maste Mar 31 18:28:04.456026 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [req-bd6bd71b-4dae-4315-8900-a993f5694d3b req-50b20aac-ac6b-407f-a4da-5b3c2d75e136 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028866 Mar 31 18:28:04.456856 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 495/978] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:28:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 31 18:28:04.465567 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-3ea63e29-60da-4911-aace-9110c965b180 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: 635a0e04-c990-4a66-81ed-ab572007484b] Going to try to terminate instance {{(pid=117539) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 31 18:28:04.761315 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-3ea63e29-60da-4911-aace-9110c965b180 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "DELETE /compute/v2.1/servers/635a0e04-c990-4a66-81ed-ab572007484b" status: 204 len: 0 microversion: 2.1 time: 0.335509 Mar 31 18:28:04.762475 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 484/979] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Mar 31 18:28:04 2022] DELETE /compute/v2.1/servers/635a0e04-c990-4a66-81ed-ab572007484b => generated 0 bytes in 338 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 31 18:28:04.771245 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-ae95b9b2-b1cc-4805-ae0f-f430117d4e15 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:28:04.771945 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-ae95b9b2-b1cc-4805-ae0f-f430117d4e15 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: 635a0e04-c990-4a66-81ed-ab572007484b] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:28:04.779298 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-ae95b9b2-b1cc-4805-ae0f-f430117d4e15 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:28:04.779742 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-ae95b9b2-b1cc-4805-ae0f-f430117d4e15 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:28:04.780606 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-ae95b9b2-b1cc-4805-ae0f-f430117d4e15 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:28:04.781087 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-ae95b9b2-b1cc-4805-ae0f-f430117d4e15 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:28:05.253997 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-ae95b9b2-b1cc-4805-ae0f-f430117d4e15 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:28:05.261639 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-ae95b9b2-b1cc-4805-ae0f-f430117d4e15 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/635a0e04-c990-4a66-81ed-ab572007484b" status: 200 len: 1575 microversion: 2.1 time: 0.494882 Mar 31 18:28:05.262807 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 496/980] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:28:04 2022] GET /compute/v2.1/servers/635a0e04-c990-4a66-81ed-ab572007484b => generated 1575 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:28:06.279907 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-ea00cf51-e5af-4f6f-bda2-a1f01077c2fe tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:28:06.280672 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-ea00cf51-e5af-4f6f-bda2-a1f01077c2fe tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: 635a0e04-c990-4a66-81ed-ab572007484b] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:28:06.286525 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ea00cf51-e5af-4f6f-bda2-a1f01077c2fe tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:28:06.286996 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ea00cf51-e5af-4f6f-bda2-a1f01077c2fe tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:28:06.287752 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ea00cf51-e5af-4f6f-bda2-a1f01077c2fe tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:28:06.288184 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ea00cf51-e5af-4f6f-bda2-a1f01077c2fe tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:28:06.354058 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-ea00cf51-e5af-4f6f-bda2-a1f01077c2fe tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:28:06.361537 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-ea00cf51-e5af-4f6f-bda2-a1f01077c2fe tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/635a0e04-c990-4a66-81ed-ab572007484b" status: 200 len: 1389 microversion: 2.1 time: 0.085797 Mar 31 18:28:06.362112 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 485/981] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:28:06 2022] GET /compute/v2.1/servers/635a0e04-c990-4a66-81ed-ab572007484b => generated 1389 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:28:06.470559 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [req-e516a097-2232-42d9-ac7b-578e6cb62cc8 req-a3690b72-c77f-4cfd-aff4-afe7a6234cf1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "635a0e04-c990-4a66-81ed-ab572007484b", "name": "network-vif-deleted", "tag": "8009d02e-5d59-48da-9d8c-071ba781cd76"}]} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:28:06.480053 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-e516a097-2232-42d9-ac7b-578e6cb62cc8 req-a3690b72-c77f-4cfd-aff4-afe7a6234cf1 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:28:06.480500 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-e516a097-2232-42d9-ac7b-578e6cb62cc8 req-a3690b72-c77f-4cfd-aff4-afe7a6234cf1 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:28:06.491408 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.compute.server_external_events [req-e516a097-2232-42d9-ac7b-578e6cb62cc8 req-a3690b72-c77f-4cfd-aff4-afe7a6234cf1 service nova] Creating event network-vif-deleted:8009d02e-5d59-48da-9d8c-071ba781cd76 for instance 635a0e04-c990-4a66-81ed-ab572007484b on hv-cinder-maste Mar 31 18:28:06.497376 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [req-e516a097-2232-42d9-ac7b-578e6cb62cc8 req-a3690b72-c77f-4cfd-aff4-afe7a6234cf1 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030234 Mar 31 18:28:06.498083 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 497/982] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:28:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:28:07.379107 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-28d8052f-1705-4bd7-b497-677c6c175da6 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:28:07.379733 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-28d8052f-1705-4bd7-b497-677c6c175da6 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: 635a0e04-c990-4a66-81ed-ab572007484b] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:28:07.385836 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-28d8052f-1705-4bd7-b497-677c6c175da6 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:28:07.392373 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-28d8052f-1705-4bd7-b497-677c6c175da6 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:28:07.392373 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-28d8052f-1705-4bd7-b497-677c6c175da6 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:28:07.392373 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-28d8052f-1705-4bd7-b497-677c6c175da6 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:28:07.423701 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-28d8052f-1705-4bd7-b497-677c6c175da6 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:28:07.424134 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-28d8052f-1705-4bd7-b497-677c6c175da6 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:28:07.424571 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.objects.instance [None req-28d8052f-1705-4bd7-b497-677c6c175da6 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lazy-loading 'fault' on Instance uuid 635a0e04-c990-4a66-81ed-ab572007484b {{(pid=117539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 31 18:28:07.464410 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-28d8052f-1705-4bd7-b497-677c6c175da6 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7c5ea90eba174068877cdcc1594ccda4', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '70f0b3390f4542c8831753ecf26f6745', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:28:07.471689 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-28d8052f-1705-4bd7-b497-677c6c175da6 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/635a0e04-c990-4a66-81ed-ab572007484b" status: 200 len: 1229 microversion: 2.1 time: 0.096481 Mar 31 18:28:07.472253 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 486/983] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:28:07 2022] GET /compute/v2.1/servers/635a0e04-c990-4a66-81ed-ab572007484b => generated 1229 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:28:08.489587 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-c72f35f8-18bd-42a3-a5da-7b19783992e0 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:28:08.495680 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-c72f35f8-18bd-42a3-a5da-7b19783992e0 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: 635a0e04-c990-4a66-81ed-ab572007484b] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:28:08.497499 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c72f35f8-18bd-42a3-a5da-7b19783992e0 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:28:08.497935 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c72f35f8-18bd-42a3-a5da-7b19783992e0 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:28:08.498744 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c72f35f8-18bd-42a3-a5da-7b19783992e0 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:28:08.499223 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c72f35f8-18bd-42a3-a5da-7b19783992e0 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:28:08.512131 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.wsgi [None req-c72f35f8-18bd-42a3-a5da-7b19783992e0 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] HTTP exception thrown: Instance 635a0e04-c990-4a66-81ed-ab572007484b could not be found. Mar 31 18:28:08.512736 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-c72f35f8-18bd-42a3-a5da-7b19783992e0 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Returning 404 to user: Instance 635a0e04-c990-4a66-81ed-ab572007484b could not be found. {{(pid=117538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:28:08.513673 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-c72f35f8-18bd-42a3-a5da-7b19783992e0 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/635a0e04-c990-4a66-81ed-ab572007484b" status: 404 len: 111 microversion: 2.1 time: 0.028292 Mar 31 18:28:08.514196 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 498/984] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:28:08 2022] GET /compute/v2.1/servers/635a0e04-c990-4a66-81ed-ab572007484b => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 31 18:28:09.054026 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-e930f1eb-a8a0-4f71-8bdf-b5d8c85690b0 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:28:09.054737 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-e930f1eb-a8a0-4f71-8bdf-b5d8c85690b0 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: 06c9b67d-f63b-4be1-ab26-18346902f6e3] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:28:09.060699 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e930f1eb-a8a0-4f71-8bdf-b5d8c85690b0 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:28:09.061394 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e930f1eb-a8a0-4f71-8bdf-b5d8c85690b0 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:28:09.061873 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e930f1eb-a8a0-4f71-8bdf-b5d8c85690b0 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:28:09.062295 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e930f1eb-a8a0-4f71-8bdf-b5d8c85690b0 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:28:09.076228 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.wsgi [None req-e930f1eb-a8a0-4f71-8bdf-b5d8c85690b0 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] HTTP exception thrown: Instance 06c9b67d-f63b-4be1-ab26-18346902f6e3 could not be found. Mar 31 18:28:09.076816 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-e930f1eb-a8a0-4f71-8bdf-b5d8c85690b0 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Returning 404 to user: Instance 06c9b67d-f63b-4be1-ab26-18346902f6e3 could not be found. {{(pid=117539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:28:09.077634 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-e930f1eb-a8a0-4f71-8bdf-b5d8c85690b0 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "DELETE /compute/v2.1/servers/06c9b67d-f63b-4be1-ab26-18346902f6e3" status: 404 len: 111 microversion: 2.1 time: 0.027556 Mar 31 18:28:09.078190 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 487/985] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Mar 31 18:28:09 2022] DELETE /compute/v2.1/servers/06c9b67d-f63b-4be1-ab26-18346902f6e3 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 31 18:28:09.087091 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-b97ae121-5dc2-4ff7-83e7-60f85b67fa24 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:28:09.087698 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-b97ae121-5dc2-4ff7-83e7-60f85b67fa24 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] [instance: 06c9b67d-f63b-4be1-ab26-18346902f6e3] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:28:09.093533 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b97ae121-5dc2-4ff7-83e7-60f85b67fa24 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:28:09.093979 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b97ae121-5dc2-4ff7-83e7-60f85b67fa24 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:28:09.094769 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b97ae121-5dc2-4ff7-83e7-60f85b67fa24 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:28:09.095233 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b97ae121-5dc2-4ff7-83e7-60f85b67fa24 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:28:09.109244 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.wsgi [None req-b97ae121-5dc2-4ff7-83e7-60f85b67fa24 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] HTTP exception thrown: Instance 06c9b67d-f63b-4be1-ab26-18346902f6e3 could not be found. Mar 31 18:28:09.109830 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-b97ae121-5dc2-4ff7-83e7-60f85b67fa24 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Returning 404 to user: Instance 06c9b67d-f63b-4be1-ab26-18346902f6e3 could not be found. {{(pid=117538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:28:09.110666 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-b97ae121-5dc2-4ff7-83e7-60f85b67fa24 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "GET /compute/v2.1/servers/06c9b67d-f63b-4be1-ab26-18346902f6e3" status: 404 len: 111 microversion: 2.1 time: 0.028102 Mar 31 18:28:09.111204 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 499/986] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:28:09 2022] GET /compute/v2.1/servers/06c9b67d-f63b-4be1-ab26-18346902f6e3 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 31 18:28:10.639459 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-e0e5cf3e-a0ba-4002-826a-fa8ae7d22260 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] Calling method '.version_select at 0x7fa4d42721f0>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:28:10.790775 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-e0e5cf3e-a0ba-4002-826a-fa8ae7d22260 tempest-TestVolumeBootPattern-2067255929 tempest-TestVolumeBootPattern-2067255929-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-270850616" status: 202 len: 0 microversion: 2.1 time: 0.154997 Mar 31 18:28:10.791359 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 488/987] 10.222.0.58 () {58 vars in 1259 bytes} [Thu Mar 31 18:28:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-270850616 => generated 0 bytes in 156 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 31 18:28:37.915475 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-48844257-99cf-48ae-bbf7-fd9cd7e28d15 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:28:37.916059 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-48844257-99cf-48ae-bbf7-fd9cd7e28d15 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 7c1ec735-055d-4f24-acec-a40cb9576c0d] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:28:37.921914 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-48844257-99cf-48ae-bbf7-fd9cd7e28d15 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:28:37.922356 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-48844257-99cf-48ae-bbf7-fd9cd7e28d15 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:28:37.923141 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-48844257-99cf-48ae-bbf7-fd9cd7e28d15 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:28:37.923573 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-48844257-99cf-48ae-bbf7-fd9cd7e28d15 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:28:37.946563 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-48844257-99cf-48ae-bbf7-fd9cd7e28d15 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d/ips" status: 200 len: 146 microversion: 2.1 time: 0.035607 Mar 31 18:28:37.947146 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 500/988] 10.222.0.58 () {58 vars in 1247 bytes} [Thu Mar 31 18:28:37 2022] GET /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d/ips => generated 146 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:28:40.853852 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-ca440eea-89a4-44c7-bee0-f6d51decb0f4 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "395f7fb1-c049-4743-92aa-6f0048cb1c5e"}} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:28:40.854928 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-ca440eea-89a4-44c7-bee0-f6d51decb0f4 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 7c1ec735-055d-4f24-acec-a40cb9576c0d] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:28:40.860691 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ca440eea-89a4-44c7-bee0-f6d51decb0f4 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:28:40.861129 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ca440eea-89a4-44c7-bee0-f6d51decb0f4 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:28:40.861880 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ca440eea-89a4-44c7-bee0-f6d51decb0f4 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:28:40.862306 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ca440eea-89a4-44c7-bee0-f6d51decb0f4 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:28:41.701847 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-ca440eea-89a4-44c7-bee0-f6d51decb0f4 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "POST /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.852341 Mar 31 18:28:41.702452 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 489/989] 10.222.0.58 () {60 vars in 1322 bytes} [Thu Mar 31 18:28:40 2022] POST /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d/os-volume_attachments => generated 194 bytes in 854 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:28:50.227172 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-71623767-5b71-4df4-ad49-5b6b4e9b1220 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:28:50.228226 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-71623767-5b71-4df4-ad49-5b6b4e9b1220 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 7c1ec735-055d-4f24-acec-a40cb9576c0d] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:28:50.234040 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-71623767-5b71-4df4-ad49-5b6b4e9b1220 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:28:50.234561 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-71623767-5b71-4df4-ad49-5b6b4e9b1220 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:28:50.235483 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-71623767-5b71-4df4-ad49-5b6b4e9b1220 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:28:50.236005 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-71623767-5b71-4df4-ad49-5b6b4e9b1220 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:28:50.265703 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-71623767-5b71-4df4-ad49-5b6b4e9b1220 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042639 Mar 31 18:28:50.266254 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 501/990] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Mar 31 18:28:50 2022] GET /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:28:50.277261 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-93a174e3-1f1a-4f54-ab5f-a05bac3b3553 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:28:50.277833 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-93a174e3-1f1a-4f54-ab5f-a05bac3b3553 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 7c1ec735-055d-4f24-acec-a40cb9576c0d] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:28:50.283852 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-93a174e3-1f1a-4f54-ab5f-a05bac3b3553 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:28:50.284287 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-93a174e3-1f1a-4f54-ab5f-a05bac3b3553 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:28:50.285037 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-93a174e3-1f1a-4f54-ab5f-a05bac3b3553 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:28:50.285467 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-93a174e3-1f1a-4f54-ab5f-a05bac3b3553 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:28:50.316218 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-93a174e3-1f1a-4f54-ab5f-a05bac3b3553 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d/os-volume_attachments/395f7fb1-c049-4743-92aa-6f0048cb1c5e" status: 200 len: 194 microversion: 2.1 time: 0.043952 Mar 31 18:28:50.316803 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 490/991] 10.222.0.58 () {58 vars in 1412 bytes} [Thu Mar 31 18:28:50 2022] GET /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d/os-volume_attachments/395f7fb1-c049-4743-92aa-6f0048cb1c5e => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:28:52.961353 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-2b6a0bbf-484e-4275-af44-ca7133c8cc0d tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2fb28f2a-fad1-41bf-89bc-5ba5816421de"}} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:28:52.962404 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-2b6a0bbf-484e-4275-af44-ca7133c8cc0d tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 7c1ec735-055d-4f24-acec-a40cb9576c0d] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:28:52.969299 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-2b6a0bbf-484e-4275-af44-ca7133c8cc0d tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:28:52.969745 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-2b6a0bbf-484e-4275-af44-ca7133c8cc0d tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:28:52.970504 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-2b6a0bbf-484e-4275-af44-ca7133c8cc0d tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:28:52.970961 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-2b6a0bbf-484e-4275-af44-ca7133c8cc0d tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:28:54.204969 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-2b6a0bbf-484e-4275-af44-ca7133c8cc0d tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "POST /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.247308 Mar 31 18:28:54.205629 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 502/992] 10.222.0.58 () {60 vars in 1322 bytes} [Thu Mar 31 18:28:52 2022] POST /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d/os-volume_attachments => generated 194 bytes in 1249 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:28:57.256892 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-032be706-1efd-4904-8e44-3eed17c048c4 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:28:57.257464 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-032be706-1efd-4904-8e44-3eed17c048c4 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 99e5e8ac-ddfc-4450-8900-3d66a7ac8910] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:28:57.264269 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-032be706-1efd-4904-8e44-3eed17c048c4 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:28:57.264705 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-032be706-1efd-4904-8e44-3eed17c048c4 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:28:57.265453 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-032be706-1efd-4904-8e44-3eed17c048c4 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:28:57.265873 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-032be706-1efd-4904-8e44-3eed17c048c4 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:28:57.288028 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-032be706-1efd-4904-8e44-3eed17c048c4 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/99e5e8ac-ddfc-4450-8900-3d66a7ac8910/ips" status: 200 len: 149 microversion: 2.1 time: 0.035078 Mar 31 18:28:57.288584 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 491/993] 10.222.0.58 () {58 vars in 1247 bytes} [Thu Mar 31 18:28:57 2022] GET /compute/v2.1/servers/99e5e8ac-ddfc-4450-8900-3d66a7ac8910/ips => generated 149 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:28:57.300649 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-960ecb02-8140-41cc-a617-32b4deedce6e tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0c48f262-fa8d-4866-94e7-85a965b27f7f"}} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:28:57.301870 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-960ecb02-8140-41cc-a617-32b4deedce6e tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 99e5e8ac-ddfc-4450-8900-3d66a7ac8910] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:28:57.308925 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-960ecb02-8140-41cc-a617-32b4deedce6e tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:28:57.309372 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-960ecb02-8140-41cc-a617-32b4deedce6e tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:28:57.310166 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-960ecb02-8140-41cc-a617-32b4deedce6e tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:28:57.310599 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-960ecb02-8140-41cc-a617-32b4deedce6e tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:28:57.387794 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.wsgi [None req-960ecb02-8140-41cc-a617-32b4deedce6e tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] HTTP exception thrown: Invalid volume: volume 0c48f262-fa8d-4866-94e7-85a965b27f7f is already attached to instances: 8d43f77a-cb85-4276-9bed-686f306ea21a Mar 31 18:28:57.388390 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-960ecb02-8140-41cc-a617-32b4deedce6e tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Returning 400 to user: Invalid volume: volume 0c48f262-fa8d-4866-94e7-85a965b27f7f is already attached to instances: 8d43f77a-cb85-4276-9bed-686f306ea21a {{(pid=117538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:28:57.389218 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-960ecb02-8140-41cc-a617-32b4deedce6e tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "POST /compute/v2.1/servers/99e5e8ac-ddfc-4450-8900-3d66a7ac8910/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.093487 Mar 31 18:28:57.389945 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 503/994] 10.222.0.58 () {60 vars in 1322 bytes} [Thu Mar 31 18:28:57 2022] POST /compute/v2.1/servers/99e5e8ac-ddfc-4450-8900-3d66a7ac8910/os-volume_attachments => generated 174 bytes in 95 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 31 18:28:57.398116 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-6f14c0a6-0d82-4541-b61c-a0afe747263a tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:28:57.398630 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-6f14c0a6-0d82-4541-b61c-a0afe747263a tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 99e5e8ac-ddfc-4450-8900-3d66a7ac8910] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:28:57.404664 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-6f14c0a6-0d82-4541-b61c-a0afe747263a tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:28:57.405109 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-6f14c0a6-0d82-4541-b61c-a0afe747263a tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:28:57.405867 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-6f14c0a6-0d82-4541-b61c-a0afe747263a tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:28:57.406296 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-6f14c0a6-0d82-4541-b61c-a0afe747263a tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:28:57.430163 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-6f14c0a6-0d82-4541-b61c-a0afe747263a tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 99e5e8ac-ddfc-4450-8900-3d66a7ac8910] Going to try to terminate instance {{(pid=117539) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 31 18:28:57.782911 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-6f14c0a6-0d82-4541-b61c-a0afe747263a tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "DELETE /compute/v2.1/servers/99e5e8ac-ddfc-4450-8900-3d66a7ac8910" status: 204 len: 0 microversion: 2.1 time: 0.388412 Mar 31 18:28:57.783508 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 492/995] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Mar 31 18:28:57 2022] DELETE /compute/v2.1/servers/99e5e8ac-ddfc-4450-8900-3d66a7ac8910 => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 31 18:28:57.791540 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-849794b6-1d99-4e5d-a33a-689d972743ba tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:28:57.792852 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-849794b6-1d99-4e5d-a33a-689d972743ba tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 99e5e8ac-ddfc-4450-8900-3d66a7ac8910] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:28:57.798827 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-849794b6-1d99-4e5d-a33a-689d972743ba tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:28:57.799265 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-849794b6-1d99-4e5d-a33a-689d972743ba tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:28:57.800019 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-849794b6-1d99-4e5d-a33a-689d972743ba tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:28:57.800440 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-849794b6-1d99-4e5d-a33a-689d972743ba tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:28:57.940421 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-849794b6-1d99-4e5d-a33a-689d972743ba tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:28:57.948486 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-849794b6-1d99-4e5d-a33a-689d972743ba tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/99e5e8ac-ddfc-4450-8900-3d66a7ac8910" status: 200 len: 1681 microversion: 2.1 time: 0.160715 Mar 31 18:28:57.949315 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 504/996] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:28:57 2022] GET /compute/v2.1/servers/99e5e8ac-ddfc-4450-8900-3d66a7ac8910 => generated 1681 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:28:58.967497 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-08ab8866-33d3-499a-b1ab-5227b65db1c9 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:28:58.968195 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-08ab8866-33d3-499a-b1ab-5227b65db1c9 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 99e5e8ac-ddfc-4450-8900-3d66a7ac8910] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:28:58.974820 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-08ab8866-33d3-499a-b1ab-5227b65db1c9 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:28:58.975267 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-08ab8866-33d3-499a-b1ab-5227b65db1c9 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:28:58.976051 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-08ab8866-33d3-499a-b1ab-5227b65db1c9 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:28:58.976480 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-08ab8866-33d3-499a-b1ab-5227b65db1c9 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:28:59.212047 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-08ab8866-33d3-499a-b1ab-5227b65db1c9 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:28:59.219723 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-08ab8866-33d3-499a-b1ab-5227b65db1c9 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/99e5e8ac-ddfc-4450-8900-3d66a7ac8910" status: 200 len: 1681 microversion: 2.1 time: 0.257436 Mar 31 18:28:59.220216 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 493/997] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:28:58 2022] GET /compute/v2.1/servers/99e5e8ac-ddfc-4450-8900-3d66a7ac8910 => generated 1681 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:29:00.236838 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-4bd8688a-f955-4041-934e-6940d540b300 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:29:00.237454 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-4bd8688a-f955-4041-934e-6940d540b300 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 99e5e8ac-ddfc-4450-8900-3d66a7ac8910] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:29:00.243922 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4bd8688a-f955-4041-934e-6940d540b300 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:00.244377 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4bd8688a-f955-4041-934e-6940d540b300 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:00.245167 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4bd8688a-f955-4041-934e-6940d540b300 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:00.245601 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4bd8688a-f955-4041-934e-6940d540b300 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:00.449435 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-4bd8688a-f955-4041-934e-6940d540b300 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:29:00.456896 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-4bd8688a-f955-4041-934e-6940d540b300 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/99e5e8ac-ddfc-4450-8900-3d66a7ac8910" status: 200 len: 1681 microversion: 2.1 time: 0.223994 Mar 31 18:29:00.457457 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 505/998] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:29:00 2022] GET /compute/v2.1/servers/99e5e8ac-ddfc-4450-8900-3d66a7ac8910 => generated 1681 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:29:00.893937 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [req-b4282ffa-9042-41fa-8612-eb52ff4e338e req-36f68028-c4b4-4553-939e-ad9aaa56b074 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "99e5e8ac-ddfc-4450-8900-3d66a7ac8910", "name": "network-vif-deleted", "tag": "d53f10e2-e3b6-45ca-951d-3dfc9e640379"}]} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:29:00.903971 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-b4282ffa-9042-41fa-8612-eb52ff4e338e req-36f68028-c4b4-4553-939e-ad9aaa56b074 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:00.914115 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-b4282ffa-9042-41fa-8612-eb52ff4e338e req-36f68028-c4b4-4553-939e-ad9aaa56b074 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:00.915011 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.compute.server_external_events [req-b4282ffa-9042-41fa-8612-eb52ff4e338e req-36f68028-c4b4-4553-939e-ad9aaa56b074 service nova] Creating event network-vif-deleted:d53f10e2-e3b6-45ca-951d-3dfc9e640379 for instance 99e5e8ac-ddfc-4450-8900-3d66a7ac8910 on hv-cinder-maste Mar 31 18:29:00.920173 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [req-b4282ffa-9042-41fa-8612-eb52ff4e338e req-36f68028-c4b4-4553-939e-ad9aaa56b074 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029865 Mar 31 18:29:00.920805 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 494/999] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:29:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:29:01.473843 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-32b47681-b5b1-484b-80ac-2dc8fc3777d7 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:29:01.474475 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-32b47681-b5b1-484b-80ac-2dc8fc3777d7 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 99e5e8ac-ddfc-4450-8900-3d66a7ac8910] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:29:01.480942 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-32b47681-b5b1-484b-80ac-2dc8fc3777d7 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:01.481396 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-32b47681-b5b1-484b-80ac-2dc8fc3777d7 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:01.482170 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-32b47681-b5b1-484b-80ac-2dc8fc3777d7 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:01.482603 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-32b47681-b5b1-484b-80ac-2dc8fc3777d7 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:01.513257 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-32b47681-b5b1-484b-80ac-2dc8fc3777d7 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:01.513699 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-32b47681-b5b1-484b-80ac-2dc8fc3777d7 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:01.514153 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.objects.instance [None req-32b47681-b5b1-484b-80ac-2dc8fc3777d7 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lazy-loading 'fault' on Instance uuid 99e5e8ac-ddfc-4450-8900-3d66a7ac8910 {{(pid=117538) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 31 18:29:01.555808 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-32b47681-b5b1-484b-80ac-2dc8fc3777d7 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:29:01.563801 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-32b47681-b5b1-484b-80ac-2dc8fc3777d7 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/99e5e8ac-ddfc-4450-8900-3d66a7ac8910" status: 200 len: 1332 microversion: 2.1 time: 0.094052 Mar 31 18:29:01.564371 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 506/1000] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:29:01 2022] GET /compute/v2.1/servers/99e5e8ac-ddfc-4450-8900-3d66a7ac8910 => generated 1332 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:29:02.581864 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-3868252b-ab00-43c8-afea-5e9e36657bd3 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:29:02.582466 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-3868252b-ab00-43c8-afea-5e9e36657bd3 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 99e5e8ac-ddfc-4450-8900-3d66a7ac8910] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:29:02.588603 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3868252b-ab00-43c8-afea-5e9e36657bd3 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:02.589041 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3868252b-ab00-43c8-afea-5e9e36657bd3 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:02.590645 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3868252b-ab00-43c8-afea-5e9e36657bd3 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:02.591076 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3868252b-ab00-43c8-afea-5e9e36657bd3 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:02.603809 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.wsgi [None req-3868252b-ab00-43c8-afea-5e9e36657bd3 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] HTTP exception thrown: Instance 99e5e8ac-ddfc-4450-8900-3d66a7ac8910 could not be found. Mar 31 18:29:02.604377 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-3868252b-ab00-43c8-afea-5e9e36657bd3 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Returning 404 to user: Instance 99e5e8ac-ddfc-4450-8900-3d66a7ac8910 could not be found. {{(pid=117539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:29:02.605178 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-3868252b-ab00-43c8-afea-5e9e36657bd3 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/99e5e8ac-ddfc-4450-8900-3d66a7ac8910" status: 404 len: 111 microversion: 2.1 time: 0.028129 Mar 31 18:29:02.605698 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 495/1001] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:29:02 2022] GET /compute/v2.1/servers/99e5e8ac-ddfc-4450-8900-3d66a7ac8910 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 31 18:29:02.614130 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-2061aeb0-fc5e-40a4-b711-1e4b14e9b6ae tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '.version_select at 0x7fa4d43ba040>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:29:02.700432 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-2061aeb0-fc5e-40a4-b711-1e4b14e9b6ae tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1955263039" status: 202 len: 0 microversion: 2.1 time: 0.089951 Mar 31 18:29:02.701007 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 507/1002] 10.222.0.58 () {58 vars in 1220 bytes} [Thu Mar 31 18:29:02 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1955263039 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 31 18:29:02.743052 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-3be4486e-0852-4026-a46c-89f38ff61c52 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:29:02.743973 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-3be4486e-0852-4026-a46c-89f38ff61c52 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 7c1ec735-055d-4f24-acec-a40cb9576c0d] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:29:02.750219 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3be4486e-0852-4026-a46c-89f38ff61c52 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:02.750696 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3be4486e-0852-4026-a46c-89f38ff61c52 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:02.751458 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3be4486e-0852-4026-a46c-89f38ff61c52 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:02.751891 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3be4486e-0852-4026-a46c-89f38ff61c52 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:02.782033 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-3be4486e-0852-4026-a46c-89f38ff61c52 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.042867 Mar 31 18:29:02.782816 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 496/1003] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Mar 31 18:29:02 2022] GET /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d/os-volume_attachments => generated 371 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:29:02.929811 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-457b2f5c-a55f-4e8c-b34d-b784d30d0b06 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:29:02.930220 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-457b2f5c-a55f-4e8c-b34d-b784d30d0b06 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 7c1ec735-055d-4f24-acec-a40cb9576c0d] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:29:02.937036 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-457b2f5c-a55f-4e8c-b34d-b784d30d0b06 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:02.937479 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-457b2f5c-a55f-4e8c-b34d-b784d30d0b06 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:02.938240 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-457b2f5c-a55f-4e8c-b34d-b784d30d0b06 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:02.938703 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-457b2f5c-a55f-4e8c-b34d-b784d30d0b06 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:02.967665 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-457b2f5c-a55f-4e8c-b34d-b784d30d0b06 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d/os-volume_attachments/395f7fb1-c049-4743-92aa-6f0048cb1c5e" status: 200 len: 194 microversion: 2.1 time: 0.041922 Mar 31 18:29:02.968247 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 508/1004] 10.222.0.58 () {58 vars in 1412 bytes} [Thu Mar 31 18:29:02 2022] GET /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d/os-volume_attachments/395f7fb1-c049-4743-92aa-6f0048cb1c5e => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:29:02.977625 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-5658d2ec-1482-463b-8b7f-efee512792b9 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:29:02.978145 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-5658d2ec-1482-463b-8b7f-efee512792b9 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 7c1ec735-055d-4f24-acec-a40cb9576c0d] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:29:02.984284 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-5658d2ec-1482-463b-8b7f-efee512792b9 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:02.984732 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-5658d2ec-1482-463b-8b7f-efee512792b9 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:02.985478 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-5658d2ec-1482-463b-8b7f-efee512792b9 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:02.985903 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-5658d2ec-1482-463b-8b7f-efee512792b9 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:03.066816 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.objects.instance [None req-5658d2ec-1482-463b-8b7f-efee512792b9 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lazy-loading 'services' on Instance uuid 7c1ec735-055d-4f24-acec-a40cb9576c0d {{(pid=117539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 31 18:29:03.361122 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-5658d2ec-1482-463b-8b7f-efee512792b9 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d/os-volume_attachments/395f7fb1-c049-4743-92aa-6f0048cb1c5e" status: 202 len: 0 microversion: 2.1 time: 0.387151 Mar 31 18:29:03.361864 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 497/1005] 10.222.0.58 () {58 vars in 1415 bytes} [Thu Mar 31 18:29:02 2022] DELETE /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d/os-volume_attachments/395f7fb1-c049-4743-92aa-6f0048cb1c5e => generated 0 bytes in 389 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 31 18:29:03.626140 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-ab0ecfa7-93a7-4c0e-89af-48bd122f92de tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:29:03.626651 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-ab0ecfa7-93a7-4c0e-89af-48bd122f92de tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 8d43f77a-cb85-4276-9bed-686f306ea21a] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:29:03.632981 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-ab0ecfa7-93a7-4c0e-89af-48bd122f92de tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:03.633418 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-ab0ecfa7-93a7-4c0e-89af-48bd122f92de tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:03.634175 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-ab0ecfa7-93a7-4c0e-89af-48bd122f92de tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:03.634599 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-ab0ecfa7-93a7-4c0e-89af-48bd122f92de tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:03.714046 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.objects.instance [None req-ab0ecfa7-93a7-4c0e-89af-48bd122f92de tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lazy-loading 'services' on Instance uuid 8d43f77a-cb85-4276-9bed-686f306ea21a {{(pid=117538) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 31 18:29:03.909395 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-ab0ecfa7-93a7-4c0e-89af-48bd122f92de tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a/os-volume_attachments/0c48f262-fa8d-4866-94e7-85a965b27f7f" status: 202 len: 0 microversion: 2.1 time: 0.287052 Mar 31 18:29:03.909891 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 509/1006] 10.222.0.58 () {58 vars in 1415 bytes} [Thu Mar 31 18:29:03 2022] DELETE /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a/os-volume_attachments/0c48f262-fa8d-4866-94e7-85a965b27f7f => generated 0 bytes in 289 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 31 18:29:03.919425 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-03b40d50-4e91-48df-8640-8c6c5de26ab2 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:29:03.920706 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-03b40d50-4e91-48df-8640-8c6c5de26ab2 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 8d43f77a-cb85-4276-9bed-686f306ea21a] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:29:03.927673 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-03b40d50-4e91-48df-8640-8c6c5de26ab2 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:03.928130 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-03b40d50-4e91-48df-8640-8c6c5de26ab2 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:03.928880 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-03b40d50-4e91-48df-8640-8c6c5de26ab2 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:03.929310 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-03b40d50-4e91-48df-8640-8c6c5de26ab2 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:03.957402 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-03b40d50-4e91-48df-8640-8c6c5de26ab2 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043120 Mar 31 18:29:03.957949 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 498/1007] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Mar 31 18:29:03 2022] GET /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:29:04.970179 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-78b9a366-ea35-4297-b92e-a3575ff8da08 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:29:04.971208 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-78b9a366-ea35-4297-b92e-a3575ff8da08 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 8d43f77a-cb85-4276-9bed-686f306ea21a] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:29:04.977243 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-78b9a366-ea35-4297-b92e-a3575ff8da08 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:04.977695 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-78b9a366-ea35-4297-b92e-a3575ff8da08 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:04.978452 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-78b9a366-ea35-4297-b92e-a3575ff8da08 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:04.978920 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-78b9a366-ea35-4297-b92e-a3575ff8da08 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:05.008039 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-78b9a366-ea35-4297-b92e-a3575ff8da08 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042749 Mar 31 18:29:05.008598 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 510/1008] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Mar 31 18:29:04 2022] GET /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:29:05.523934 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-68a4e88b-4fc0-460c-9770-51e4005129e4 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:29:05.524435 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-68a4e88b-4fc0-460c-9770-51e4005129e4 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 7c1ec735-055d-4f24-acec-a40cb9576c0d] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:29:05.530717 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-68a4e88b-4fc0-460c-9770-51e4005129e4 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:05.531156 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-68a4e88b-4fc0-460c-9770-51e4005129e4 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:05.531912 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-68a4e88b-4fc0-460c-9770-51e4005129e4 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:05.532338 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-68a4e88b-4fc0-460c-9770-51e4005129e4 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:05.560655 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-68a4e88b-4fc0-460c-9770-51e4005129e4 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d/os-volume_attachments/2fb28f2a-fad1-41bf-89bc-5ba5816421de" status: 200 len: 194 microversion: 2.1 time: 0.040890 Mar 31 18:29:05.561218 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 499/1009] 10.222.0.58 () {58 vars in 1412 bytes} [Thu Mar 31 18:29:05 2022] GET /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d/os-volume_attachments/2fb28f2a-fad1-41bf-89bc-5ba5816421de => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 31 18:29:05.571062 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-08e3499c-e990-4b83-8b71-c01848f1a884 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:29:05.571551 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-08e3499c-e990-4b83-8b71-c01848f1a884 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 7c1ec735-055d-4f24-acec-a40cb9576c0d] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:29:05.577337 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-08e3499c-e990-4b83-8b71-c01848f1a884 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:05.577783 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-08e3499c-e990-4b83-8b71-c01848f1a884 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:05.578543 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-08e3499c-e990-4b83-8b71-c01848f1a884 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:05.579001 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-08e3499c-e990-4b83-8b71-c01848f1a884 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:05.660645 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.objects.instance [None req-08e3499c-e990-4b83-8b71-c01848f1a884 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lazy-loading 'services' on Instance uuid 7c1ec735-055d-4f24-acec-a40cb9576c0d {{(pid=117538) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 31 18:29:05.907820 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-08e3499c-e990-4b83-8b71-c01848f1a884 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d/os-volume_attachments/2fb28f2a-fad1-41bf-89bc-5ba5816421de" status: 202 len: 0 microversion: 2.1 time: 0.340618 Mar 31 18:29:05.908510 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 511/1010] 10.222.0.58 () {58 vars in 1415 bytes} [Thu Mar 31 18:29:05 2022] DELETE /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d/os-volume_attachments/2fb28f2a-fad1-41bf-89bc-5ba5816421de => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 31 18:29:06.020307 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-9ed76d2e-bd68-46e2-beae-40eb40bb3a51 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:29:06.021380 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-9ed76d2e-bd68-46e2-beae-40eb40bb3a51 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 8d43f77a-cb85-4276-9bed-686f306ea21a] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:29:06.027702 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9ed76d2e-bd68-46e2-beae-40eb40bb3a51 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:06.028159 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9ed76d2e-bd68-46e2-beae-40eb40bb3a51 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:06.028946 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9ed76d2e-bd68-46e2-beae-40eb40bb3a51 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:06.029400 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9ed76d2e-bd68-46e2-beae-40eb40bb3a51 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:06.060421 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-9ed76d2e-bd68-46e2-beae-40eb40bb3a51 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044080 Mar 31 18:29:06.061242 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 500/1011] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Mar 31 18:29:06 2022] GET /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 31 18:29:06.118730 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-1a6dfd0e-3731-43b8-8897-edbeb6967bbd tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:29:06.119313 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-1a6dfd0e-3731-43b8-8897-edbeb6967bbd tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 8d43f77a-cb85-4276-9bed-686f306ea21a] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:29:06.126532 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-1a6dfd0e-3731-43b8-8897-edbeb6967bbd tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:06.127026 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-1a6dfd0e-3731-43b8-8897-edbeb6967bbd tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:06.127840 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-1a6dfd0e-3731-43b8-8897-edbeb6967bbd tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:06.128361 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-1a6dfd0e-3731-43b8-8897-edbeb6967bbd tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:06.152601 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-1a6dfd0e-3731-43b8-8897-edbeb6967bbd tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 8d43f77a-cb85-4276-9bed-686f306ea21a] Going to try to terminate instance {{(pid=117538) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 31 18:29:06.447041 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-1a6dfd0e-3731-43b8-8897-edbeb6967bbd tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a" status: 204 len: 0 microversion: 2.1 time: 0.332057 Mar 31 18:29:06.447824 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 512/1012] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Mar 31 18:29:06 2022] DELETE /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 31 18:29:06.455773 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-6d3c34b0-f1a9-4c03-ae45-5248dd52c9fe tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:29:06.456386 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-6d3c34b0-f1a9-4c03-ae45-5248dd52c9fe tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 8d43f77a-cb85-4276-9bed-686f306ea21a] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:29:06.462366 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-6d3c34b0-f1a9-4c03-ae45-5248dd52c9fe tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:06.462842 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-6d3c34b0-f1a9-4c03-ae45-5248dd52c9fe tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:06.463596 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-6d3c34b0-f1a9-4c03-ae45-5248dd52c9fe tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:06.464026 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-6d3c34b0-f1a9-4c03-ae45-5248dd52c9fe tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:06.600163 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-6d3c34b0-f1a9-4c03-ae45-5248dd52c9fe tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:29:06.608082 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-6d3c34b0-f1a9-4c03-ae45-5248dd52c9fe tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a" status: 200 len: 1681 microversion: 2.1 time: 0.156199 Mar 31 18:29:06.608640 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 501/1013] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:29:06 2022] GET /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:29:07.627195 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-3daa6b99-2c54-4baa-8b27-9d4dda27818c tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:29:07.627885 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-3daa6b99-2c54-4baa-8b27-9d4dda27818c tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 8d43f77a-cb85-4276-9bed-686f306ea21a] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:29:07.634274 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3daa6b99-2c54-4baa-8b27-9d4dda27818c tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:07.634753 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3daa6b99-2c54-4baa-8b27-9d4dda27818c tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:07.635511 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3daa6b99-2c54-4baa-8b27-9d4dda27818c tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:07.635941 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3daa6b99-2c54-4baa-8b27-9d4dda27818c tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:07.768843 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-3daa6b99-2c54-4baa-8b27-9d4dda27818c tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:29:07.776539 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-3daa6b99-2c54-4baa-8b27-9d4dda27818c tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a" status: 200 len: 1681 microversion: 2.1 time: 0.153675 Mar 31 18:29:07.777130 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 513/1014] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:29:07 2022] GET /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a => generated 1681 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:29:08.117970 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-c1dc2a94-5255-45bf-b16e-ceb796bcec2e tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:29:08.118929 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-c1dc2a94-5255-45bf-b16e-ceb796bcec2e tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 7c1ec735-055d-4f24-acec-a40cb9576c0d] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:29:08.125245 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c1dc2a94-5255-45bf-b16e-ceb796bcec2e tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:08.125687 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c1dc2a94-5255-45bf-b16e-ceb796bcec2e tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:08.126445 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c1dc2a94-5255-45bf-b16e-ceb796bcec2e tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:08.126917 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c1dc2a94-5255-45bf-b16e-ceb796bcec2e tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:08.156673 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-c1dc2a94-5255-45bf-b16e-ceb796bcec2e tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042519 Mar 31 18:29:08.157233 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 502/1015] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Mar 31 18:29:08 2022] GET /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 31 18:29:08.262201 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-29b8b629-fb8c-4003-ac46-e278e4bd2458 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:29:08.263213 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-29b8b629-fb8c-4003-ac46-e278e4bd2458 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 7c1ec735-055d-4f24-acec-a40cb9576c0d] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:29:08.268963 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-29b8b629-fb8c-4003-ac46-e278e4bd2458 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:08.269408 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-29b8b629-fb8c-4003-ac46-e278e4bd2458 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:08.270166 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-29b8b629-fb8c-4003-ac46-e278e4bd2458 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:08.270663 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-29b8b629-fb8c-4003-ac46-e278e4bd2458 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:08.299844 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-29b8b629-fb8c-4003-ac46-e278e4bd2458 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041519 Mar 31 18:29:08.300577 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 514/1016] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Mar 31 18:29:08 2022] GET /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 31 18:29:08.357037 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-ce194880-170f-43b8-8436-a9e11d3451cd tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:29:08.357491 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-ce194880-170f-43b8-8436-a9e11d3451cd tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 7c1ec735-055d-4f24-acec-a40cb9576c0d] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:29:08.363234 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ce194880-170f-43b8-8436-a9e11d3451cd tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:08.363669 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ce194880-170f-43b8-8436-a9e11d3451cd tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:08.364414 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ce194880-170f-43b8-8436-a9e11d3451cd tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:08.364834 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ce194880-170f-43b8-8436-a9e11d3451cd tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:08.388691 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-ce194880-170f-43b8-8436-a9e11d3451cd tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 7c1ec735-055d-4f24-acec-a40cb9576c0d] Going to try to terminate instance {{(pid=117539) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 31 18:29:08.737985 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-ce194880-170f-43b8-8436-a9e11d3451cd tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d" status: 204 len: 0 microversion: 2.1 time: 0.384639 Mar 31 18:29:08.738903 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 503/1017] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Mar 31 18:29:08 2022] DELETE /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d => generated 0 bytes in 386 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 31 18:29:08.747649 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-f130481b-e412-4f09-9112-c36b586ebcce tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:29:08.748503 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-f130481b-e412-4f09-9112-c36b586ebcce tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 7c1ec735-055d-4f24-acec-a40cb9576c0d] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:29:08.755126 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f130481b-e412-4f09-9112-c36b586ebcce tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:08.756247 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f130481b-e412-4f09-9112-c36b586ebcce tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:08.756465 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f130481b-e412-4f09-9112-c36b586ebcce tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:08.756745 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-f130481b-e412-4f09-9112-c36b586ebcce tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:08.794968 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-8b7df619-2800-4e28-9587-496d753b217c tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:29:08.795675 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-8b7df619-2800-4e28-9587-496d753b217c tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 8d43f77a-cb85-4276-9bed-686f306ea21a] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:29:08.801597 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-8b7df619-2800-4e28-9587-496d753b217c tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:08.802036 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-8b7df619-2800-4e28-9587-496d753b217c tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:08.802881 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-8b7df619-2800-4e28-9587-496d753b217c tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:08.803265 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-8b7df619-2800-4e28-9587-496d753b217c tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:08.951004 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-8b7df619-2800-4e28-9587-496d753b217c tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:29:08.959627 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-8b7df619-2800-4e28-9587-496d753b217c tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a" status: 200 len: 1681 microversion: 2.1 time: 0.169526 Mar 31 18:29:08.960473 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 504/1018] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:29:08 2022] GET /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a => generated 1681 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:29:09.029083 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-f130481b-e412-4f09-9112-c36b586ebcce tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:29:09.038081 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-f130481b-e412-4f09-9112-c36b586ebcce tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d" status: 200 len: 1672 microversion: 2.1 time: 0.295117 Mar 31 18:29:09.038812 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 515/1019] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:29:08 2022] GET /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d => generated 1672 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:29:09.581004 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [req-8dbd8144-b18b-45fa-9f94-03922f3341f5 req-cafe46ac-07ca-45ca-951f-d12a7c02a1e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8d43f77a-cb85-4276-9bed-686f306ea21a", "name": "network-vif-deleted", "tag": "66cb4db2-f182-4e79-945c-41d2828096bb"}]} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:29:09.589329 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-8dbd8144-b18b-45fa-9f94-03922f3341f5 req-cafe46ac-07ca-45ca-951f-d12a7c02a1e8 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:09.589763 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-8dbd8144-b18b-45fa-9f94-03922f3341f5 req-cafe46ac-07ca-45ca-951f-d12a7c02a1e8 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:09.602130 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.compute.server_external_events [req-8dbd8144-b18b-45fa-9f94-03922f3341f5 req-cafe46ac-07ca-45ca-951f-d12a7c02a1e8 service nova] Creating event network-vif-deleted:66cb4db2-f182-4e79-945c-41d2828096bb for instance 8d43f77a-cb85-4276-9bed-686f306ea21a on hv-cinder-maste Mar 31 18:29:09.607873 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [req-8dbd8144-b18b-45fa-9f94-03922f3341f5 req-cafe46ac-07ca-45ca-951f-d12a7c02a1e8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030486 Mar 31 18:29:09.608463 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 505/1020] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:29:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 31 18:29:09.631126 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Mar 31 18:29:09.631427 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: Thu Mar 31 18:29:09 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 31 18:29:09.977288 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-b3bb7f2a-dcd8-435b-b51f-0b6fbe0eb163 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:29:09.977977 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-b3bb7f2a-dcd8-435b-b51f-0b6fbe0eb163 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 8d43f77a-cb85-4276-9bed-686f306ea21a] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:29:09.986931 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b3bb7f2a-dcd8-435b-b51f-0b6fbe0eb163 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:09.987378 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b3bb7f2a-dcd8-435b-b51f-0b6fbe0eb163 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:09.988157 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b3bb7f2a-dcd8-435b-b51f-0b6fbe0eb163 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:09.988586 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b3bb7f2a-dcd8-435b-b51f-0b6fbe0eb163 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:10.019601 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b3bb7f2a-dcd8-435b-b51f-0b6fbe0eb163 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:10.020039 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b3bb7f2a-dcd8-435b-b51f-0b6fbe0eb163 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:10.020482 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.objects.instance [None req-b3bb7f2a-dcd8-435b-b51f-0b6fbe0eb163 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lazy-loading 'fault' on Instance uuid 8d43f77a-cb85-4276-9bed-686f306ea21a {{(pid=117538) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 31 18:29:10.067956 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-b3bb7f2a-dcd8-435b-b51f-0b6fbe0eb163 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:29:10.069342 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-3896cb80-2a06-4832-b896-08d616120e45 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:29:10.070473 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-3896cb80-2a06-4832-b896-08d616120e45 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 7c1ec735-055d-4f24-acec-a40cb9576c0d] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:29:10.078820 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3896cb80-2a06-4832-b896-08d616120e45 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:10.079030 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-b3bb7f2a-dcd8-435b-b51f-0b6fbe0eb163 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a" status: 200 len: 1331 microversion: 2.1 time: 0.105343 Mar 31 18:29:10.079670 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3896cb80-2a06-4832-b896-08d616120e45 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:10.088583 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 516/1021] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:29:09 2022] GET /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a => generated 1331 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:29:10.088701 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3896cb80-2a06-4832-b896-08d616120e45 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:10.088701 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3896cb80-2a06-4832-b896-08d616120e45 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:10.229552 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-3896cb80-2a06-4832-b896-08d616120e45 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:29:10.240989 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-3896cb80-2a06-4832-b896-08d616120e45 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d" status: 200 len: 1672 microversion: 2.1 time: 0.186579 Mar 31 18:29:10.241677 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 506/1022] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:29:10 2022] GET /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d => generated 1672 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:29:11.097039 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-00ad32cb-a339-4075-b23a-c14c7bcde0b8 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:29:11.097681 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-00ad32cb-a339-4075-b23a-c14c7bcde0b8 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 8d43f77a-cb85-4276-9bed-686f306ea21a] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:29:11.103965 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-00ad32cb-a339-4075-b23a-c14c7bcde0b8 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:11.104408 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-00ad32cb-a339-4075-b23a-c14c7bcde0b8 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:11.105174 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-00ad32cb-a339-4075-b23a-c14c7bcde0b8 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:11.105604 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-00ad32cb-a339-4075-b23a-c14c7bcde0b8 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:11.118714 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.wsgi [None req-00ad32cb-a339-4075-b23a-c14c7bcde0b8 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] HTTP exception thrown: Instance 8d43f77a-cb85-4276-9bed-686f306ea21a could not be found. Mar 31 18:29:11.119298 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-00ad32cb-a339-4075-b23a-c14c7bcde0b8 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Returning 404 to user: Instance 8d43f77a-cb85-4276-9bed-686f306ea21a could not be found. {{(pid=117538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:29:11.120113 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-00ad32cb-a339-4075-b23a-c14c7bcde0b8 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a" status: 404 len: 111 microversion: 2.1 time: 0.027463 Mar 31 18:29:11.120644 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 517/1023] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:29:11 2022] GET /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 31 18:29:11.129613 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-72585b89-23e5-49b7-aba5-ec494bcb93e8 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '.version_select at 0x7fa4d41ba280>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:29:11.202860 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-72585b89-23e5-49b7-aba5-ec494bcb93e8 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-185317611" status: 202 len: 0 microversion: 2.1 time: 0.076931 Mar 31 18:29:11.203441 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 507/1024] 10.222.0.58 () {58 vars in 1217 bytes} [Thu Mar 31 18:29:11 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-185317611 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Mar 31 18:29:11.259668 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-9e3cadbe-67f6-4ac1-933f-5b98e63e6003 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:29:11.260281 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-9e3cadbe-67f6-4ac1-933f-5b98e63e6003 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 7c1ec735-055d-4f24-acec-a40cb9576c0d] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:29:11.267396 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9e3cadbe-67f6-4ac1-933f-5b98e63e6003 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:11.267885 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9e3cadbe-67f6-4ac1-933f-5b98e63e6003 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:11.268663 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9e3cadbe-67f6-4ac1-933f-5b98e63e6003 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:11.269102 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9e3cadbe-67f6-4ac1-933f-5b98e63e6003 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:11.780150 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-9e3cadbe-67f6-4ac1-933f-5b98e63e6003 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:29:11.788195 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-9e3cadbe-67f6-4ac1-933f-5b98e63e6003 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d" status: 200 len: 1672 microversion: 2.1 time: 0.532478 Mar 31 18:29:11.788768 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 518/1025] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:29:11 2022] GET /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d => generated 1672 bytes in 534 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:29:12.173851 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-b972ba3e-7702-4f6e-90a0-54c550d7b256 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Action: 'create', calling method: .version_select at 0x7fa4d4143820>, body: {"keypair": {"name": "tempest-keypair-1484986762"}} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:29:12.190177 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.quota [None req-b972ba3e-7702-4f6e-90a0-54c550d7b256 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Getting quotas for project 7ae2325a87da4c5f8179a77fbd3d8748. Resources: {'key_pairs'} {{(pid=117539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 31 18:29:12.194556 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.quota [None req-b972ba3e-7702-4f6e-90a0-54c550d7b256 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Getting quotas for user 211572ee7ab5422981422eaed6341657 and project 7ae2325a87da4c5f8179a77fbd3d8748. Resources: {'key_pairs'} {{(pid=117539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 31 18:29:12.439596 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.quota [None req-b972ba3e-7702-4f6e-90a0-54c550d7b256 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Getting quotas for project 7ae2325a87da4c5f8179a77fbd3d8748. Resources: {'key_pairs'} {{(pid=117539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 31 18:29:12.443359 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.quota [None req-b972ba3e-7702-4f6e-90a0-54c550d7b256 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Getting quotas for user 211572ee7ab5422981422eaed6341657 and project 7ae2325a87da4c5f8179a77fbd3d8748. Resources: {'key_pairs'} {{(pid=117539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 31 18:29:12.456469 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-b972ba3e-7702-4f6e-90a0-54c550d7b256 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.286423 Mar 31 18:29:12.457257 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 508/1026] 10.222.0.58 () {60 vars in 1157 bytes} [Thu Mar 31 18:29:12 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:29:12.642050 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [req-712235ff-fae7-4a7e-a220-0176d133a893 req-9cf356a5-4e37-4db6-be0f-731512e36b2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7c1ec735-055d-4f24-acec-a40cb9576c0d", "name": "network-vif-deleted", "tag": "1f4cdbaf-59bc-42f8-968b-9f65a74c2312"}]} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:29:12.651051 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-712235ff-fae7-4a7e-a220-0176d133a893 req-9cf356a5-4e37-4db6-be0f-731512e36b2e service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:12.651488 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-712235ff-fae7-4a7e-a220-0176d133a893 req-9cf356a5-4e37-4db6-be0f-731512e36b2e service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:12.663987 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.compute.server_external_events [req-712235ff-fae7-4a7e-a220-0176d133a893 req-9cf356a5-4e37-4db6-be0f-731512e36b2e service nova] Creating event network-vif-deleted:1f4cdbaf-59bc-42f8-968b-9f65a74c2312 for instance 7c1ec735-055d-4f24-acec-a40cb9576c0d on hv-cinder-maste Mar 31 18:29:12.669728 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [req-712235ff-fae7-4a7e-a220-0176d133a893 req-9cf356a5-4e37-4db6-be0f-731512e36b2e service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031271 Mar 31 18:29:12.673275 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 519/1027] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:29:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:29:12.809401 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-d8cd9cbc-2a1f-42ad-b7c4-79cab9697c82 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:29:12.810409 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-d8cd9cbc-2a1f-42ad-b7c4-79cab9697c82 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 7c1ec735-055d-4f24-acec-a40cb9576c0d] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:29:12.816381 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-d8cd9cbc-2a1f-42ad-b7c4-79cab9697c82 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:12.816913 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-d8cd9cbc-2a1f-42ad-b7c4-79cab9697c82 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:12.817791 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-d8cd9cbc-2a1f-42ad-b7c4-79cab9697c82 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:12.818232 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-d8cd9cbc-2a1f-42ad-b7c4-79cab9697c82 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:12.888221 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-d8cd9cbc-2a1f-42ad-b7c4-79cab9697c82 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c1a075de217449d9a941a7bc3c4c99c3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '87baab8d37b040efbfe030d17be30823', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:29:12.896526 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-d8cd9cbc-2a1f-42ad-b7c4-79cab9697c82 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d" status: 200 len: 1320 microversion: 2.1 time: 0.091080 Mar 31 18:29:12.897390 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 509/1028] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:29:12 2022] GET /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d => generated 1320 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:29:13.922627 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-534f07e1-e736-48b6-9dcc-9045c86d8355 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:29:13.923340 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-534f07e1-e736-48b6-9dcc-9045c86d8355 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 7c1ec735-055d-4f24-acec-a40cb9576c0d] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:29:13.929379 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-534f07e1-e736-48b6-9dcc-9045c86d8355 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:13.929829 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-534f07e1-e736-48b6-9dcc-9045c86d8355 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:13.930595 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-534f07e1-e736-48b6-9dcc-9045c86d8355 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:13.931056 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-534f07e1-e736-48b6-9dcc-9045c86d8355 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:13.945040 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.wsgi [None req-534f07e1-e736-48b6-9dcc-9045c86d8355 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] HTTP exception thrown: Instance 7c1ec735-055d-4f24-acec-a40cb9576c0d could not be found. Mar 31 18:29:13.945623 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-534f07e1-e736-48b6-9dcc-9045c86d8355 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Returning 404 to user: Instance 7c1ec735-055d-4f24-acec-a40cb9576c0d could not be found. {{(pid=117538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:29:13.946452 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-534f07e1-e736-48b6-9dcc-9045c86d8355 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d" status: 404 len: 111 microversion: 2.1 time: 0.028597 Mar 31 18:29:13.947030 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 520/1029] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:29:13 2022] GET /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 31 18:29:13.957864 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-60e824d2-b56b-4802-ad69-beb01efd6a08 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '.version_select at 0x7fa4d4143ca0>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:29:14.036590 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-60e824d2-b56b-4802-ad69-beb01efd6a08 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-60832592" status: 202 len: 0 microversion: 2.1 time: 0.083170 Mar 31 18:29:14.037175 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 510/1030] 10.222.0.58 () {58 vars in 1214 bytes} [Thu Mar 31 18:29:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-60832592 => generated 0 bytes in 84 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 31 18:29:14.927470 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-74faf66e-713d-4c23-86a6-98eecabcae9b tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2015354402", "imageRef": "6241b999-6f6d-4076-88bc-345fa7386256", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "48b6e4a0-767f-4f89-81e1-af0f127e9429"}], "security_groups": [{"name": "tempest-securitygroup--887918468"}], "key_name": "tempest-keypair-1484986762", "user_data": "}} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:29:15.034117 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.network.neutron [None req-74faf66e-713d-4c23-86a6-98eecabcae9b tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] validate_networks() for [('48b6e4a0-767f-4f89-81e1-af0f127e9429', None, None, None, None, None)] {{(pid=117538) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 31 18:29:15.400865 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.virt.hardware [None req-74faf66e-713d-4c23-86a6-98eecabcae9b tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Flavor limits 0:0:0 {{(pid=117538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 31 18:29:15.401287 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.virt.hardware [None req-74faf66e-713d-4c23-86a6-98eecabcae9b tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Image limits 0:0:0 {{(pid=117538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 31 18:29:15.401756 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.virt.hardware [None req-74faf66e-713d-4c23-86a6-98eecabcae9b tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Flavor pref 0:0:0 {{(pid=117538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 31 18:29:15.402158 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.virt.hardware [None req-74faf66e-713d-4c23-86a6-98eecabcae9b tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Image pref 0:0:0 {{(pid=117538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 31 18:29:15.403231 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.virt.hardware [None req-74faf66e-713d-4c23-86a6-98eecabcae9b tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 31 18:29:15.411805 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-74faf66e-713d-4c23-86a6-98eecabcae9b tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:15.412242 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-74faf66e-713d-4c23-86a6-98eecabcae9b tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:15.413040 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-74faf66e-713d-4c23-86a6-98eecabcae9b tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:15.413471 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-74faf66e-713d-4c23-86a6-98eecabcae9b tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:15.429869 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.quota [None req-74faf66e-713d-4c23-86a6-98eecabcae9b tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Getting quotas for project 7ae2325a87da4c5f8179a77fbd3d8748. Resources: {'instances', 'ram', 'cores'} {{(pid=117538) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 31 18:29:15.433684 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.quota [None req-74faf66e-713d-4c23-86a6-98eecabcae9b tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Getting quotas for user 211572ee7ab5422981422eaed6341657 and project 7ae2325a87da4c5f8179a77fbd3d8748. Resources: {'instances', 'ram', 'cores'} {{(pid=117538) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 31 18:29:15.444302 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-74faf66e-713d-4c23-86a6-98eecabcae9b tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Going to run 1 instances... {{(pid=117538) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 31 18:29:15.446521 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-74faf66e-713d-4c23-86a6-98eecabcae9b tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 889ca463-c9ab-4380-b6b1-fc95ddacda07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6241b999-6f6d-4076-88bc-345fa7386256',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117538) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 31 18:29:15.559604 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-74faf66e-713d-4c23-86a6-98eecabcae9b tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.636467 Mar 31 18:29:15.560364 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 521/1031] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Mar 31 18:29:14 2022] POST /compute/v2.1/servers => generated 401 bytes in 638 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 31 18:29:15.571072 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-413bc1c6-bf93-458f-961c-9cef93565504 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:29:15.571678 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-413bc1c6-bf93-458f-961c-9cef93565504 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 889ca463-c9ab-4380-b6b1-fc95ddacda07] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:29:15.627033 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-413bc1c6-bf93-458f-961c-9cef93565504 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:29:15.633378 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-413bc1c6-bf93-458f-961c-9cef93565504 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/889ca463-c9ab-4380-b6b1-fc95ddacda07" status: 200 len: 1242 microversion: 2.1 time: 0.066516 Mar 31 18:29:15.633953 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 511/1032] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:29:15 2022] GET /compute/v2.1/servers/889ca463-c9ab-4380-b6b1-fc95ddacda07 => generated 1242 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:29:16.650616 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-bcf15309-aef6-4191-956b-d0e3ee7757fe tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:29:16.651178 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-bcf15309-aef6-4191-956b-d0e3ee7757fe tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 889ca463-c9ab-4380-b6b1-fc95ddacda07] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:29:16.657393 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-bcf15309-aef6-4191-956b-d0e3ee7757fe tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:16.657866 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-bcf15309-aef6-4191-956b-d0e3ee7757fe tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:16.658646 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-bcf15309-aef6-4191-956b-d0e3ee7757fe tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:16.659086 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-bcf15309-aef6-4191-956b-d0e3ee7757fe tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:16.720758 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-bcf15309-aef6-4191-956b-d0e3ee7757fe tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:29:16.727957 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-bcf15309-aef6-4191-956b-d0e3ee7757fe tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/889ca463-c9ab-4380-b6b1-fc95ddacda07" status: 200 len: 1246 microversion: 2.1 time: 0.082191 Mar 31 18:29:16.728514 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 522/1033] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:29:16 2022] GET /compute/v2.1/servers/889ca463-c9ab-4380-b6b1-fc95ddacda07 => generated 1246 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:29:17.515494 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-58e2bea6-e12b-4f2a-ae76-a06ec4d0f8a4 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:29:17.515980 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-58e2bea6-e12b-4f2a-ae76-a06ec4d0f8a4 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 7c1ec735-055d-4f24-acec-a40cb9576c0d] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:29:17.522219 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-58e2bea6-e12b-4f2a-ae76-a06ec4d0f8a4 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:17.522686 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-58e2bea6-e12b-4f2a-ae76-a06ec4d0f8a4 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:17.523730 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-58e2bea6-e12b-4f2a-ae76-a06ec4d0f8a4 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:17.524154 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-58e2bea6-e12b-4f2a-ae76-a06ec4d0f8a4 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:17.537516 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.wsgi [None req-58e2bea6-e12b-4f2a-ae76-a06ec4d0f8a4 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] HTTP exception thrown: Instance 7c1ec735-055d-4f24-acec-a40cb9576c0d could not be found. Mar 31 18:29:17.538152 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-58e2bea6-e12b-4f2a-ae76-a06ec4d0f8a4 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Returning 404 to user: Instance 7c1ec735-055d-4f24-acec-a40cb9576c0d could not be found. {{(pid=117539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:29:17.538981 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-58e2bea6-e12b-4f2a-ae76-a06ec4d0f8a4 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d" status: 404 len: 111 microversion: 2.1 time: 0.028102 Mar 31 18:29:17.539518 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 512/1034] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Mar 31 18:29:17 2022] DELETE /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 31 18:29:17.548039 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-29c3a81a-cb2d-4d85-963f-4366abc29872 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:29:17.548777 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-29c3a81a-cb2d-4d85-963f-4366abc29872 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 7c1ec735-055d-4f24-acec-a40cb9576c0d] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:29:17.554732 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-29c3a81a-cb2d-4d85-963f-4366abc29872 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:17.555181 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-29c3a81a-cb2d-4d85-963f-4366abc29872 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:17.555951 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-29c3a81a-cb2d-4d85-963f-4366abc29872 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:17.556387 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-29c3a81a-cb2d-4d85-963f-4366abc29872 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:17.569911 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.wsgi [None req-29c3a81a-cb2d-4d85-963f-4366abc29872 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] HTTP exception thrown: Instance 7c1ec735-055d-4f24-acec-a40cb9576c0d could not be found. Mar 31 18:29:17.570563 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-29c3a81a-cb2d-4d85-963f-4366abc29872 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Returning 404 to user: Instance 7c1ec735-055d-4f24-acec-a40cb9576c0d could not be found. {{(pid=117538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:29:17.571696 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-29c3a81a-cb2d-4d85-963f-4366abc29872 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d" status: 404 len: 111 microversion: 2.1 time: 0.027784 Mar 31 18:29:17.572242 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 523/1035] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:29:17 2022] GET /compute/v2.1/servers/7c1ec735-055d-4f24-acec-a40cb9576c0d => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 31 18:29:17.745137 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-4f690925-7199-42d7-bccd-a9d967694c1a tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:29:17.745653 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-4f690925-7199-42d7-bccd-a9d967694c1a tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 889ca463-c9ab-4380-b6b1-fc95ddacda07] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:29:17.751963 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-4f690925-7199-42d7-bccd-a9d967694c1a tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:17.752400 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-4f690925-7199-42d7-bccd-a9d967694c1a tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:17.753148 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-4f690925-7199-42d7-bccd-a9d967694c1a tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:17.753571 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-4f690925-7199-42d7-bccd-a9d967694c1a tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:17.820252 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-4f690925-7199-42d7-bccd-a9d967694c1a tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:29:17.833526 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-4f690925-7199-42d7-bccd-a9d967694c1a tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/889ca463-c9ab-4380-b6b1-fc95ddacda07" status: 200 len: 1302 microversion: 2.1 time: 0.092220 Mar 31 18:29:17.834094 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 513/1036] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:29:17 2022] GET /compute/v2.1/servers/889ca463-c9ab-4380-b6b1-fc95ddacda07 => generated 1302 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:29:18.850133 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-53d8b4bb-9a5e-4111-83e7-f60ccd918405 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:29:18.850995 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-53d8b4bb-9a5e-4111-83e7-f60ccd918405 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 889ca463-c9ab-4380-b6b1-fc95ddacda07] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:29:18.858335 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-53d8b4bb-9a5e-4111-83e7-f60ccd918405 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:18.858968 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-53d8b4bb-9a5e-4111-83e7-f60ccd918405 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:18.859737 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-53d8b4bb-9a5e-4111-83e7-f60ccd918405 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:18.860173 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-53d8b4bb-9a5e-4111-83e7-f60ccd918405 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:18.861603 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-d3b39198-dab0-46ed-8447-43b0e95216fa tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:29:18.862072 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-d3b39198-dab0-46ed-8447-43b0e95216fa tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:29:18.868428 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-d3b39198-dab0-46ed-8447-43b0e95216fa tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:18.868880 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-d3b39198-dab0-46ed-8447-43b0e95216fa tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:18.869652 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-d3b39198-dab0-46ed-8447-43b0e95216fa tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:18.870268 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-d3b39198-dab0-46ed-8447-43b0e95216fa tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:19.037793 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.wsgi [None req-d3b39198-dab0-46ed-8447-43b0e95216fa tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] HTTP exception thrown: Instance 01ac6bc8-6406-46d8-b8a1-628449e68e58 could not be found. Mar 31 18:29:19.038406 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-d3b39198-dab0-46ed-8447-43b0e95216fa tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Returning 404 to user: Instance 01ac6bc8-6406-46d8-b8a1-628449e68e58 could not be found. {{(pid=117539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:29:19.039270 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-d3b39198-dab0-46ed-8447-43b0e95216fa tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "DELETE /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58" status: 404 len: 111 microversion: 2.1 time: 0.181443 Mar 31 18:29:19.039832 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 514/1037] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Mar 31 18:29:18 2022] DELETE /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58 => generated 111 bytes in 182 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 31 18:29:19.047609 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-ed9f4f79-ff89-4445-98c4-3ddf2cdec9d3 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:29:19.048213 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-ed9f4f79-ff89-4445-98c4-3ddf2cdec9d3 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] [instance: 01ac6bc8-6406-46d8-b8a1-628449e68e58] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:29:19.054946 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ed9f4f79-ff89-4445-98c4-3ddf2cdec9d3 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:19.055401 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ed9f4f79-ff89-4445-98c4-3ddf2cdec9d3 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:19.056205 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ed9f4f79-ff89-4445-98c4-3ddf2cdec9d3 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:19.056639 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ed9f4f79-ff89-4445-98c4-3ddf2cdec9d3 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:19.062548 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-53d8b4bb-9a5e-4111-83e7-f60ccd918405 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:29:19.070104 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-53d8b4bb-9a5e-4111-83e7-f60ccd918405 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/889ca463-c9ab-4380-b6b1-fc95ddacda07" status: 200 len: 1367 microversion: 2.1 time: 0.223818 Mar 31 18:29:19.076804 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 524/1038] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:29:18 2022] GET /compute/v2.1/servers/889ca463-c9ab-4380-b6b1-fc95ddacda07 => generated 1367 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:29:19.076933 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.wsgi [None req-ed9f4f79-ff89-4445-98c4-3ddf2cdec9d3 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] HTTP exception thrown: Instance 01ac6bc8-6406-46d8-b8a1-628449e68e58 could not be found. Mar 31 18:29:19.076933 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-ed9f4f79-ff89-4445-98c4-3ddf2cdec9d3 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] Returning 404 to user: Instance 01ac6bc8-6406-46d8-b8a1-628449e68e58 could not be found. {{(pid=117539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:29:19.076933 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-ed9f4f79-ff89-4445-98c4-3ddf2cdec9d3 tempest-AttachVolumeTestJSON-1714156628 tempest-AttachVolumeTestJSON-1714156628-project] 10.222.0.58 "GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58" status: 404 len: 111 microversion: 2.1 time: 0.028283 Mar 31 18:29:19.076933 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 515/1039] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:29:19 2022] GET /compute/v2.1/servers/01ac6bc8-6406-46d8-b8a1-628449e68e58 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Mar 31 18:29:19.606186 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [req-69b39d91-098e-41ab-b5c7-5347dc4f13c0 req-bccb2b6b-1c59-4377-b711-b050887def9a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "889ca463-c9ab-4380-b6b1-fc95ddacda07", "tag": "d3323f32-595b-4f94-b81b-12a527728d9a"}]} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:29:19.616177 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-69b39d91-098e-41ab-b5c7-5347dc4f13c0 req-bccb2b6b-1c59-4377-b711-b050887def9a service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:19.616677 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-69b39d91-098e-41ab-b5c7-5347dc4f13c0 req-bccb2b6b-1c59-4377-b711-b050887def9a service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:19.631773 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.compute.server_external_events [req-69b39d91-098e-41ab-b5c7-5347dc4f13c0 req-bccb2b6b-1c59-4377-b711-b050887def9a service nova] Creating event network-changed:d3323f32-595b-4f94-b81b-12a527728d9a for instance 889ca463-c9ab-4380-b6b1-fc95ddacda07 on hv-cinder-maste Mar 31 18:29:19.638266 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [req-69b39d91-098e-41ab-b5c7-5347dc4f13c0 req-bccb2b6b-1c59-4377-b711-b050887def9a service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035151 Mar 31 18:29:19.639536 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 525/1040] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:29:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:29:20.092193 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-42d86721-e4d5-48be-8d4b-ab2680708cc8 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:29:20.092886 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-42d86721-e4d5-48be-8d4b-ab2680708cc8 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 889ca463-c9ab-4380-b6b1-fc95ddacda07] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:29:20.100575 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-42d86721-e4d5-48be-8d4b-ab2680708cc8 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:20.101185 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-42d86721-e4d5-48be-8d4b-ab2680708cc8 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:20.101951 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-42d86721-e4d5-48be-8d4b-ab2680708cc8 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:20.102374 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-42d86721-e4d5-48be-8d4b-ab2680708cc8 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:20.235949 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-42d86721-e4d5-48be-8d4b-ab2680708cc8 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:29:20.243001 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-42d86721-e4d5-48be-8d4b-ab2680708cc8 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/889ca463-c9ab-4380-b6b1-fc95ddacda07" status: 200 len: 1367 microversion: 2.1 time: 0.154714 Mar 31 18:29:20.243551 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 516/1041] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:29:20 2022] GET /compute/v2.1/servers/889ca463-c9ab-4380-b6b1-fc95ddacda07 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:29:21.261646 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-57b87ed0-453c-4bce-a49c-2bc4d286671b tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:29:21.263184 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-57b87ed0-453c-4bce-a49c-2bc4d286671b tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 889ca463-c9ab-4380-b6b1-fc95ddacda07] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:29:21.269934 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-57b87ed0-453c-4bce-a49c-2bc4d286671b tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:21.270530 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-57b87ed0-453c-4bce-a49c-2bc4d286671b tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:21.271472 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-57b87ed0-453c-4bce-a49c-2bc4d286671b tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:21.271901 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-57b87ed0-453c-4bce-a49c-2bc4d286671b tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:21.539480 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-57b87ed0-453c-4bce-a49c-2bc4d286671b tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:29:21.547344 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-57b87ed0-453c-4bce-a49c-2bc4d286671b tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/889ca463-c9ab-4380-b6b1-fc95ddacda07" status: 200 len: 1367 microversion: 2.1 time: 0.289943 Mar 31 18:29:21.547930 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 526/1042] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:29:21 2022] GET /compute/v2.1/servers/889ca463-c9ab-4380-b6b1-fc95ddacda07 => generated 1367 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:29:22.564548 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-a6ac7a47-47c1-4a32-9cb7-9df26092576d tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:29:22.565252 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-a6ac7a47-47c1-4a32-9cb7-9df26092576d tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 889ca463-c9ab-4380-b6b1-fc95ddacda07] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:29:22.571660 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a6ac7a47-47c1-4a32-9cb7-9df26092576d tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:22.572106 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a6ac7a47-47c1-4a32-9cb7-9df26092576d tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:22.572881 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a6ac7a47-47c1-4a32-9cb7-9df26092576d tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:22.573312 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a6ac7a47-47c1-4a32-9cb7-9df26092576d tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:22.717477 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-a6ac7a47-47c1-4a32-9cb7-9df26092576d tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:29:22.725038 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-a6ac7a47-47c1-4a32-9cb7-9df26092576d tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/889ca463-c9ab-4380-b6b1-fc95ddacda07" status: 200 len: 1367 microversion: 2.1 time: 0.164199 Mar 31 18:29:22.725686 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 517/1043] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:29:22 2022] GET /compute/v2.1/servers/889ca463-c9ab-4380-b6b1-fc95ddacda07 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:29:23.741976 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-7be6cb8e-f6b9-4d47-8b76-e91612a3d115 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:29:23.742502 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-7be6cb8e-f6b9-4d47-8b76-e91612a3d115 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 889ca463-c9ab-4380-b6b1-fc95ddacda07] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:29:23.749404 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-7be6cb8e-f6b9-4d47-8b76-e91612a3d115 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:23.749842 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-7be6cb8e-f6b9-4d47-8b76-e91612a3d115 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:23.750595 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-7be6cb8e-f6b9-4d47-8b76-e91612a3d115 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:23.751262 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-7be6cb8e-f6b9-4d47-8b76-e91612a3d115 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:23.883055 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-7be6cb8e-f6b9-4d47-8b76-e91612a3d115 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:29:23.890304 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-7be6cb8e-f6b9-4d47-8b76-e91612a3d115 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/889ca463-c9ab-4380-b6b1-fc95ddacda07" status: 200 len: 1367 microversion: 2.1 time: 0.152249 Mar 31 18:29:23.894424 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 527/1044] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:29:23 2022] GET /compute/v2.1/servers/889ca463-c9ab-4380-b6b1-fc95ddacda07 => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:29:24.907633 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-79c3dbac-f36c-4b44-82c4-08fb4668f2db tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:29:24.908233 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-79c3dbac-f36c-4b44-82c4-08fb4668f2db tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 889ca463-c9ab-4380-b6b1-fc95ddacda07] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:29:24.914354 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-79c3dbac-f36c-4b44-82c4-08fb4668f2db tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:24.914830 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-79c3dbac-f36c-4b44-82c4-08fb4668f2db tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:24.915585 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-79c3dbac-f36c-4b44-82c4-08fb4668f2db tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:24.916011 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-79c3dbac-f36c-4b44-82c4-08fb4668f2db tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:25.053843 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-79c3dbac-f36c-4b44-82c4-08fb4668f2db tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:29:25.062868 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-79c3dbac-f36c-4b44-82c4-08fb4668f2db tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/889ca463-c9ab-4380-b6b1-fc95ddacda07" status: 200 len: 1367 microversion: 2.1 time: 0.159269 Mar 31 18:29:25.063789 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 518/1045] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:29:24 2022] GET /compute/v2.1/servers/889ca463-c9ab-4380-b6b1-fc95ddacda07 => generated 1367 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:29:26.079557 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-c62b7f9c-fc11-446f-94ea-78025636cb2d tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:29:26.080174 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-c62b7f9c-fc11-446f-94ea-78025636cb2d tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 889ca463-c9ab-4380-b6b1-fc95ddacda07] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:29:26.086673 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c62b7f9c-fc11-446f-94ea-78025636cb2d tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:26.101261 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c62b7f9c-fc11-446f-94ea-78025636cb2d tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:26.101261 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c62b7f9c-fc11-446f-94ea-78025636cb2d tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:26.101261 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c62b7f9c-fc11-446f-94ea-78025636cb2d tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:26.219220 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-c62b7f9c-fc11-446f-94ea-78025636cb2d tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:29:26.226494 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-c62b7f9c-fc11-446f-94ea-78025636cb2d tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/889ca463-c9ab-4380-b6b1-fc95ddacda07" status: 200 len: 1367 microversion: 2.1 time: 0.150748 Mar 31 18:29:26.227025 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 528/1046] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:29:26 2022] GET /compute/v2.1/servers/889ca463-c9ab-4380-b6b1-fc95ddacda07 => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:29:26.923329 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [req-137a6113-1d2e-47ad-9123-0e3806e9e97b req-682e6446-17ad-41b8-a290-da2f1e3600cb service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "889ca463-c9ab-4380-b6b1-fc95ddacda07", "name": "network-vif-plugged", "status": "completed", "tag": "d3323f32-595b-4f94-b81b-12a527728d9a"}]} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:29:26.931415 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-137a6113-1d2e-47ad-9123-0e3806e9e97b req-682e6446-17ad-41b8-a290-da2f1e3600cb service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:26.931854 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-137a6113-1d2e-47ad-9123-0e3806e9e97b req-682e6446-17ad-41b8-a290-da2f1e3600cb service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:26.942682 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.compute.server_external_events [req-137a6113-1d2e-47ad-9123-0e3806e9e97b req-682e6446-17ad-41b8-a290-da2f1e3600cb service nova] Creating event network-vif-plugged:d3323f32-595b-4f94-b81b-12a527728d9a for instance 889ca463-c9ab-4380-b6b1-fc95ddacda07 on hv-cinder-maste Mar 31 18:29:26.947657 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [req-137a6113-1d2e-47ad-9123-0e3806e9e97b req-682e6446-17ad-41b8-a290-da2f1e3600cb service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028298 Mar 31 18:29:26.948248 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 519/1047] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:29:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:29:27.243602 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-cbdb0280-7f43-42ab-b656-fdcb23bb59b8 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:29:27.244234 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-cbdb0280-7f43-42ab-b656-fdcb23bb59b8 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 889ca463-c9ab-4380-b6b1-fc95ddacda07] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:29:27.250426 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-cbdb0280-7f43-42ab-b656-fdcb23bb59b8 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:27.250908 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-cbdb0280-7f43-42ab-b656-fdcb23bb59b8 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:27.251642 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-cbdb0280-7f43-42ab-b656-fdcb23bb59b8 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:27.252067 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-cbdb0280-7f43-42ab-b656-fdcb23bb59b8 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:27.443553 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-cbdb0280-7f43-42ab-b656-fdcb23bb59b8 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:29:27.451576 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-cbdb0280-7f43-42ab-b656-fdcb23bb59b8 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/889ca463-c9ab-4380-b6b1-fc95ddacda07" status: 200 len: 1367 microversion: 2.1 time: 0.211086 Mar 31 18:29:27.452145 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 529/1048] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:29:27 2022] GET /compute/v2.1/servers/889ca463-c9ab-4380-b6b1-fc95ddacda07 => generated 1367 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:29:28.469255 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-7ae5ff37-19a6-48e6-bbf9-38951f4ab63d tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:29:28.469949 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-7ae5ff37-19a6-48e6-bbf9-38951f4ab63d tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 889ca463-c9ab-4380-b6b1-fc95ddacda07] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:29:28.476552 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-7ae5ff37-19a6-48e6-bbf9-38951f4ab63d tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:28.476992 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-7ae5ff37-19a6-48e6-bbf9-38951f4ab63d tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:28.477742 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-7ae5ff37-19a6-48e6-bbf9-38951f4ab63d tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:28.478165 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-7ae5ff37-19a6-48e6-bbf9-38951f4ab63d tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:28.548651 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-302aae21-b768-4021-a59b-17dbf96d2dbd tempest-VolumesTestJSON-1129653670 tempest-VolumesTestJSON-1129653670-project] Calling method '.version_select at 0x7fa4d42e4160>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:29:28.595782 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-302aae21-b768-4021-a59b-17dbf96d2dbd tempest-VolumesTestJSON-1129653670 tempest-VolumesTestJSON-1129653670-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/c1c77402-1666-462a-b0e3-c64312878bd1" status: 200 len: 348 microversion: 2.1 time: 0.051414 Mar 31 18:29:28.596384 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 530/1049] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Mar 31 18:29:28 2022] GET /compute/v2.1/os-volumes/c1c77402-1666-462a-b0e3-c64312878bd1 => generated 348 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 31 18:29:28.618029 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-7ae5ff37-19a6-48e6-bbf9-38951f4ab63d tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:29:28.625742 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-7ae5ff37-19a6-48e6-bbf9-38951f4ab63d tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/889ca463-c9ab-4380-b6b1-fc95ddacda07" status: 200 len: 1367 microversion: 2.1 time: 0.161041 Mar 31 18:29:28.626308 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 520/1050] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:29:28 2022] GET /compute/v2.1/servers/889ca463-c9ab-4380-b6b1-fc95ddacda07 => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:29:29.648073 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-53e4f41a-2f17-4a77-a562-74478724d6bf tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:29:29.648937 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-53e4f41a-2f17-4a77-a562-74478724d6bf tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 889ca463-c9ab-4380-b6b1-fc95ddacda07] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:29:29.655581 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-53e4f41a-2f17-4a77-a562-74478724d6bf tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:29.656191 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-53e4f41a-2f17-4a77-a562-74478724d6bf tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:29.656972 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-53e4f41a-2f17-4a77-a562-74478724d6bf tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:29.657395 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-53e4f41a-2f17-4a77-a562-74478724d6bf tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:29.788409 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-53e4f41a-2f17-4a77-a562-74478724d6bf tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:29:29.796158 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-53e4f41a-2f17-4a77-a562-74478724d6bf tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/889ca463-c9ab-4380-b6b1-fc95ddacda07" status: 200 len: 1557 microversion: 2.1 time: 0.152420 Mar 31 18:29:29.796714 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 531/1051] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:29:29 2022] GET /compute/v2.1/servers/889ca463-c9ab-4380-b6b1-fc95ddacda07 => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:29:29.812661 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-c469840f-afbe-4e1c-8bfa-98b96a7ee15e tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:29:29.813166 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-c469840f-afbe-4e1c-8bfa-98b96a7ee15e tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 889ca463-c9ab-4380-b6b1-fc95ddacda07] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:29:29.819398 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c469840f-afbe-4e1c-8bfa-98b96a7ee15e tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:29.819845 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c469840f-afbe-4e1c-8bfa-98b96a7ee15e tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:29.820600 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c469840f-afbe-4e1c-8bfa-98b96a7ee15e tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:29.821028 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c469840f-afbe-4e1c-8bfa-98b96a7ee15e tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:29.905746 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-c469840f-afbe-4e1c-8bfa-98b96a7ee15e tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/889ca463-c9ab-4380-b6b1-fc95ddacda07/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.097617 Mar 31 18:29:29.906436 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 521/1052] 10.222.0.58 () {58 vars in 1274 bytes} [Thu Mar 31 18:29:29 2022] GET /compute/v2.1/servers/889ca463-c9ab-4380-b6b1-fc95ddacda07/os-interface => generated 285 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:29:31.156949 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [req-a0c82e54-3e1b-4bfb-9314-dfcaa5c02c0b req-26677a07-9627-4f08-b11c-3d6e52b0fec0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "889ca463-c9ab-4380-b6b1-fc95ddacda07", "tag": "d3323f32-595b-4f94-b81b-12a527728d9a"}]} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:29:31.165155 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-a0c82e54-3e1b-4bfb-9314-dfcaa5c02c0b req-26677a07-9627-4f08-b11c-3d6e52b0fec0 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:29:31.165594 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-a0c82e54-3e1b-4bfb-9314-dfcaa5c02c0b req-26677a07-9627-4f08-b11c-3d6e52b0fec0 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:29:31.178993 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.compute.server_external_events [req-a0c82e54-3e1b-4bfb-9314-dfcaa5c02c0b req-26677a07-9627-4f08-b11c-3d6e52b0fec0 service nova] Creating event network-changed:d3323f32-595b-4f94-b81b-12a527728d9a for instance 889ca463-c9ab-4380-b6b1-fc95ddacda07 on hv-cinder-maste Mar 31 18:29:31.184065 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [req-a0c82e54-3e1b-4bfb-9314-dfcaa5c02c0b req-26677a07-9627-4f08-b11c-3d6e52b0fec0 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031467 Mar 31 18:29:31.184782 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 532/1053] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:29:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:29:31.234402 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-008d4057-8b75-449b-bc2b-68d8e4ab23a9 tempest-VolumesTestJSON-1129653670 tempest-VolumesTestJSON-1129653670-project] Calling method '.version_select at 0x7fa4d4493d30>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:29:31.305167 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-008d4057-8b75-449b-bc2b-68d8e4ab23a9 tempest-VolumesTestJSON-1129653670 tempest-VolumesTestJSON-1129653670-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/2af1dd31-40da-4a7b-9adc-08c4028657a7" status: 200 len: 350 microversion: 2.1 time: 0.065770 Mar 31 18:29:31.305167 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 522/1054] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Mar 31 18:29:31 2022] GET /compute/v2.1/os-volumes/2af1dd31-40da-4a7b-9adc-08c4028657a7 => generated 350 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:29:33.009177 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-88e1d65e-1fa8-4f44-8a34-c4042393964b tempest-VolumesTestJSON-1129653670 tempest-VolumesTestJSON-1129653670-project] Calling method '.version_select at 0x7fa4d44ab820>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:29:33.056812 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-88e1d65e-1fa8-4f44-8a34-c4042393964b tempest-VolumesTestJSON-1129653670 tempest-VolumesTestJSON-1129653670-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/63a7e79a-d69a-4e32-b9db-e94a1f1acd38" status: 200 len: 351 microversion: 2.1 time: 0.051615 Mar 31 18:29:33.057383 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 533/1055] 10.222.0.58 () {58 vars in 1244 bytes} [Thu Mar 31 18:29:33 2022] GET /compute/v2.1/os-volumes/63a7e79a-d69a-4e32-b9db-e94a1f1acd38 => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:29:33.069202 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-ad452df4-b786-4db5-a024-6ab9aaad1529 tempest-VolumesTestJSON-1129653670 tempest-VolumesTestJSON-1129653670-project] Calling method '.version_select at 0x7fa4d4101040>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:29:33.149144 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-ad452df4-b786-4db5-a024-6ab9aaad1529 tempest-VolumesTestJSON-1129653670 tempest-VolumesTestJSON-1129653670-project] 10.222.0.58 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.083855 Mar 31 18:29:33.149796 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 523/1056] 10.222.0.58 () {58 vars in 1133 bytes} [Thu Mar 31 18:29:33 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:29:33.162663 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-4bffdb4e-73f4-4a42-ba45-f8e74d0c0901 tempest-VolumesTestJSON-1129653670 tempest-VolumesTestJSON-1129653670-project] Calling method '.version_select at 0x7fa4d43ba040>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:29:33.245450 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-4bffdb4e-73f4-4a42-ba45-f8e74d0c0901 tempest-VolumesTestJSON-1129653670 tempest-VolumesTestJSON-1129653670-project] 10.222.0.58 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.086478 Mar 31 18:29:33.246008 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 534/1057] 10.222.0.58 () {58 vars in 1148 bytes} [Thu Mar 31 18:29:33 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:29:33.257619 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-6f02d95a-eee1-45ec-863d-7338c84db19a tempest-VolumesTestJSON-1129653670 tempest-VolumesTestJSON-1129653670-project] Calling method '.version_select at 0x7fa4d4333ee0>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:29:33.337403 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-6f02d95a-eee1-45ec-863d-7338c84db19a tempest-VolumesTestJSON-1129653670 tempest-VolumesTestJSON-1129653670-project] 10.222.0.58 "GET /compute/v2.1/os-volumes" status: 200 len: 1032 microversion: 2.1 time: 0.083469 Mar 31 18:29:33.337964 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 524/1058] 10.222.0.58 () {58 vars in 1133 bytes} [Thu Mar 31 18:29:33 2022] GET /compute/v2.1/os-volumes => generated 1032 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:29:33.349765 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-b79831d7-c0c0-435a-9132-6dae778b33b3 tempest-VolumesTestJSON-1129653670 tempest-VolumesTestJSON-1129653670-project] Calling method '.version_select at 0x7fa4d42b0f70>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:29:33.428311 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-b79831d7-c0c0-435a-9132-6dae778b33b3 tempest-VolumesTestJSON-1129653670 tempest-VolumesTestJSON-1129653670-project] 10.222.0.58 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.082222 Mar 31 18:29:33.428882 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 535/1059] 10.222.0.58 () {58 vars in 1166 bytes} [Thu Mar 31 18:29:33 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:29:33.440458 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-cc0e80b4-d441-40dc-9355-06c2bd7c3928 tempest-VolumesTestJSON-1129653670 tempest-VolumesTestJSON-1129653670-project] Calling method '.version_select at 0x7fa4d4333a60>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:29:33.519359 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-cc0e80b4-d441-40dc-9355-06c2bd7c3928 tempest-VolumesTestJSON-1129653670 tempest-VolumesTestJSON-1129653670-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.082579 Mar 31 18:29:33.519911 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 525/1060] 10.222.0.58 () {58 vars in 1169 bytes} [Thu Mar 31 18:29:33 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:29:33.531880 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-eabea1b4-155d-4e11-a5a4-38b05c36d387 tempest-VolumesTestJSON-1129653670 tempest-VolumesTestJSON-1129653670-project] Calling method '.version_select at 0x7fa4d43a51f0>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:29:33.610368 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-eabea1b4-155d-4e11-a5a4-38b05c36d387 tempest-VolumesTestJSON-1129653670 tempest-VolumesTestJSON-1129653670-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.082140 Mar 31 18:29:33.610978 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 536/1061] 10.222.0.58 () {58 vars in 1154 bytes} [Thu Mar 31 18:29:33 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:29:33.621750 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-de3e63e9-39f3-4f18-be4b-792104417c51 tempest-VolumesTestJSON-1129653670 tempest-VolumesTestJSON-1129653670-project] Calling method '.version_select at 0x7fa4d4101040>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:29:33.702410 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-de3e63e9-39f3-4f18-be4b-792104417c51 tempest-VolumesTestJSON-1129653670 tempest-VolumesTestJSON-1129653670-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.084260 Mar 31 18:29:33.702999 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 526/1062] 10.222.0.58 () {58 vars in 1187 bytes} [Thu Mar 31 18:29:33 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:29:33.714335 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-7786b93b-b13f-4559-b16d-ed88614e7af9 tempest-VolumesTestJSON-1129653670 tempest-VolumesTestJSON-1129653670-project] Calling method '.version_select at 0x7fa4d43ba040>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:29:33.795500 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-7786b93b-b13f-4559-b16d-ed88614e7af9 tempest-VolumesTestJSON-1129653670 tempest-VolumesTestJSON-1129653670-project] 10.222.0.58 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1032 microversion: 2.1 time: 0.084921 Mar 31 18:29:33.796071 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 537/1063] 10.222.0.58 () {58 vars in 1154 bytes} [Thu Mar 31 18:29:33 2022] GET /compute/v2.1/os-volumes/detail => generated 1032 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:30:23.986864 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 31 18:30:23.987461 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: Thu Mar 31 18:30:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 31 18:30:46.659165 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-6823fa65-597d-42ad-9c41-c15fe76af179 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:30:46.659849 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-6823fa65-597d-42ad-9c41-c15fe76af179 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 889ca463-c9ab-4380-b6b1-fc95ddacda07] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:30:46.665896 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-6823fa65-597d-42ad-9c41-c15fe76af179 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:30:46.666394 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-6823fa65-597d-42ad-9c41-c15fe76af179 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:30:46.667202 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-6823fa65-597d-42ad-9c41-c15fe76af179 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:30:46.667637 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-6823fa65-597d-42ad-9c41-c15fe76af179 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:30:46.691721 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-6823fa65-597d-42ad-9c41-c15fe76af179 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/889ca463-c9ab-4380-b6b1-fc95ddacda07/ips" status: 200 len: 149 microversion: 2.1 time: 0.255490 Mar 31 18:30:46.692315 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 527/1064] 10.222.0.58 () {58 vars in 1247 bytes} [Thu Mar 31 18:30:46 2022] GET /compute/v2.1/servers/889ca463-c9ab-4380-b6b1-fc95ddacda07/ips => generated 149 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:30:49.456520 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-a64c78dc-2713-466c-a0fc-8b1dfafeee7d tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c850e8d5-05db-46bc-813c-99bfe592cbba"}} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:30:49.457682 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-a64c78dc-2713-466c-a0fc-8b1dfafeee7d tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 889ca463-c9ab-4380-b6b1-fc95ddacda07] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:30:49.464479 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a64c78dc-2713-466c-a0fc-8b1dfafeee7d tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:30:49.464922 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a64c78dc-2713-466c-a0fc-8b1dfafeee7d tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:30:49.465690 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a64c78dc-2713-466c-a0fc-8b1dfafeee7d tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:30:49.466123 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a64c78dc-2713-466c-a0fc-8b1dfafeee7d tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:30:50.401562 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-a64c78dc-2713-466c-a0fc-8b1dfafeee7d tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "POST /compute/v2.1/servers/889ca463-c9ab-4380-b6b1-fc95ddacda07/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.950161 Mar 31 18:30:50.402371 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 538/1065] 10.222.0.58 () {60 vars in 1322 bytes} [Thu Mar 31 18:30:49 2022] POST /compute/v2.1/servers/889ca463-c9ab-4380-b6b1-fc95ddacda07/os-volume_attachments => generated 194 bytes in 952 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:30:58.940902 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-33b73e72-2a5f-48bf-92fe-b8721c2743c7 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c850e8d5-05db-46bc-813c-99bfe592cbba"}} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:30:58.941952 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-33b73e72-2a5f-48bf-92fe-b8721c2743c7 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 889ca463-c9ab-4380-b6b1-fc95ddacda07] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:30:58.948345 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-33b73e72-2a5f-48bf-92fe-b8721c2743c7 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:30:58.948816 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-33b73e72-2a5f-48bf-92fe-b8721c2743c7 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:30:58.950123 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-33b73e72-2a5f-48bf-92fe-b8721c2743c7 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:30:58.950123 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-33b73e72-2a5f-48bf-92fe-b8721c2743c7 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:30:59.028210 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.wsgi [None req-33b73e72-2a5f-48bf-92fe-b8721c2743c7 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] HTTP exception thrown: Invalid volume: volume c850e8d5-05db-46bc-813c-99bfe592cbba is already attached to instances: 889ca463-c9ab-4380-b6b1-fc95ddacda07 Mar 31 18:30:59.028810 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-33b73e72-2a5f-48bf-92fe-b8721c2743c7 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Returning 400 to user: Invalid volume: volume c850e8d5-05db-46bc-813c-99bfe592cbba is already attached to instances: 889ca463-c9ab-4380-b6b1-fc95ddacda07 {{(pid=117539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:30:59.029785 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-33b73e72-2a5f-48bf-92fe-b8721c2743c7 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "POST /compute/v2.1/servers/889ca463-c9ab-4380-b6b1-fc95ddacda07/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.092841 Mar 31 18:30:59.030331 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 528/1066] 10.222.0.58 () {60 vars in 1322 bytes} [Thu Mar 31 18:30:58 2022] POST /compute/v2.1/servers/889ca463-c9ab-4380-b6b1-fc95ddacda07/os-volume_attachments => generated 174 bytes in 94 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Mar 31 18:30:59.100521 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-a3cc6782-58fd-4e48-a5d0-43b10c21f7cf tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:30:59.101095 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-a3cc6782-58fd-4e48-a5d0-43b10c21f7cf tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 889ca463-c9ab-4380-b6b1-fc95ddacda07] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:30:59.107221 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a3cc6782-58fd-4e48-a5d0-43b10c21f7cf tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:30:59.107668 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a3cc6782-58fd-4e48-a5d0-43b10c21f7cf tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:30:59.108609 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a3cc6782-58fd-4e48-a5d0-43b10c21f7cf tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:30:59.109048 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a3cc6782-58fd-4e48-a5d0-43b10c21f7cf tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:30:59.188158 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.objects.instance [None req-a3cc6782-58fd-4e48-a5d0-43b10c21f7cf tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lazy-loading 'services' on Instance uuid 889ca463-c9ab-4380-b6b1-fc95ddacda07 {{(pid=117538) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 31 18:30:59.425465 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-a3cc6782-58fd-4e48-a5d0-43b10c21f7cf tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "DELETE /compute/v2.1/servers/889ca463-c9ab-4380-b6b1-fc95ddacda07/os-volume_attachments/c850e8d5-05db-46bc-813c-99bfe592cbba" status: 202 len: 0 microversion: 2.1 time: 0.329519 Mar 31 18:30:59.426042 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 539/1067] 10.222.0.58 () {58 vars in 1415 bytes} [Thu Mar 31 18:30:59 2022] DELETE /compute/v2.1/servers/889ca463-c9ab-4380-b6b1-fc95ddacda07/os-volume_attachments/c850e8d5-05db-46bc-813c-99bfe592cbba => generated 0 bytes in 331 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 31 18:30:59.435176 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-064f65bd-5de3-4cfe-a181-377ec468b8b2 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:30:59.436693 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-064f65bd-5de3-4cfe-a181-377ec468b8b2 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 889ca463-c9ab-4380-b6b1-fc95ddacda07] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:30:59.443261 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-064f65bd-5de3-4cfe-a181-377ec468b8b2 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:30:59.457851 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-064f65bd-5de3-4cfe-a181-377ec468b8b2 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:30:59.457851 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-064f65bd-5de3-4cfe-a181-377ec468b8b2 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:30:59.457851 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-064f65bd-5de3-4cfe-a181-377ec468b8b2 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:30:59.472868 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-064f65bd-5de3-4cfe-a181-377ec468b8b2 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/889ca463-c9ab-4380-b6b1-fc95ddacda07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042447 Mar 31 18:30:59.473423 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 529/1068] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Mar 31 18:30:59 2022] GET /compute/v2.1/servers/889ca463-c9ab-4380-b6b1-fc95ddacda07/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:31:00.486317 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-6fda9b92-8610-4d59-bb4b-642646a3e4b3 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:31:00.487363 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-6fda9b92-8610-4d59-bb4b-642646a3e4b3 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 889ca463-c9ab-4380-b6b1-fc95ddacda07] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:31:00.493463 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6fda9b92-8610-4d59-bb4b-642646a3e4b3 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:31:00.496612 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6fda9b92-8610-4d59-bb4b-642646a3e4b3 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:31:00.496612 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6fda9b92-8610-4d59-bb4b-642646a3e4b3 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:31:00.496612 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6fda9b92-8610-4d59-bb4b-642646a3e4b3 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:31:00.523516 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-6fda9b92-8610-4d59-bb4b-642646a3e4b3 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/889ca463-c9ab-4380-b6b1-fc95ddacda07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042652 Mar 31 18:31:00.524059 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 540/1069] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Mar 31 18:31:00 2022] GET /compute/v2.1/servers/889ca463-c9ab-4380-b6b1-fc95ddacda07/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:31:01.535511 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-e639fc24-8dbe-403b-afce-1ef1e693e73d tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:31:01.536447 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-e639fc24-8dbe-403b-afce-1ef1e693e73d tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 889ca463-c9ab-4380-b6b1-fc95ddacda07] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:31:01.542689 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e639fc24-8dbe-403b-afce-1ef1e693e73d tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:31:01.543126 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e639fc24-8dbe-403b-afce-1ef1e693e73d tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:31:01.543869 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e639fc24-8dbe-403b-afce-1ef1e693e73d tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:31:01.544291 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e639fc24-8dbe-403b-afce-1ef1e693e73d tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:31:01.573186 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-e639fc24-8dbe-403b-afce-1ef1e693e73d tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/889ca463-c9ab-4380-b6b1-fc95ddacda07/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041545 Mar 31 18:31:01.573752 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 530/1070] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Mar 31 18:31:01 2022] GET /compute/v2.1/servers/889ca463-c9ab-4380-b6b1-fc95ddacda07/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 31 18:31:01.630295 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-92704ecb-6202-4bea-ae87-8a6a5a721460 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:31:01.630829 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-92704ecb-6202-4bea-ae87-8a6a5a721460 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 889ca463-c9ab-4380-b6b1-fc95ddacda07] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:31:01.637409 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-92704ecb-6202-4bea-ae87-8a6a5a721460 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:31:01.637855 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-92704ecb-6202-4bea-ae87-8a6a5a721460 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:31:01.638758 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-92704ecb-6202-4bea-ae87-8a6a5a721460 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:31:01.639242 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-92704ecb-6202-4bea-ae87-8a6a5a721460 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:31:01.663737 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-92704ecb-6202-4bea-ae87-8a6a5a721460 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 889ca463-c9ab-4380-b6b1-fc95ddacda07] Going to try to terminate instance {{(pid=117538) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 31 18:31:02.037137 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-92704ecb-6202-4bea-ae87-8a6a5a721460 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "DELETE /compute/v2.1/servers/889ca463-c9ab-4380-b6b1-fc95ddacda07" status: 204 len: 0 microversion: 2.1 time: 0.410533 Mar 31 18:31:02.037777 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 541/1071] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Mar 31 18:31:01 2022] DELETE /compute/v2.1/servers/889ca463-c9ab-4380-b6b1-fc95ddacda07 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 31 18:31:02.045997 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-2bf66c50-0107-43f0-9817-9357a7bfb293 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:31:02.047325 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-2bf66c50-0107-43f0-9817-9357a7bfb293 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 889ca463-c9ab-4380-b6b1-fc95ddacda07] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:31:02.053307 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-2bf66c50-0107-43f0-9817-9357a7bfb293 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:31:02.053747 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-2bf66c50-0107-43f0-9817-9357a7bfb293 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:31:02.054513 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-2bf66c50-0107-43f0-9817-9357a7bfb293 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:31:02.054974 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-2bf66c50-0107-43f0-9817-9357a7bfb293 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:31:02.190235 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-2bf66c50-0107-43f0-9817-9357a7bfb293 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:31:02.197598 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-2bf66c50-0107-43f0-9817-9357a7bfb293 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/889ca463-c9ab-4380-b6b1-fc95ddacda07" status: 200 len: 1681 microversion: 2.1 time: 0.155536 Mar 31 18:31:02.198161 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 531/1072] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:31:02 2022] GET /compute/v2.1/servers/889ca463-c9ab-4380-b6b1-fc95ddacda07 => generated 1681 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:31:03.215811 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-6caa8d22-1fcb-433d-85d6-fe95ff9994de tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:31:03.216497 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-6caa8d22-1fcb-433d-85d6-fe95ff9994de tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 889ca463-c9ab-4380-b6b1-fc95ddacda07] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:31:03.223071 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6caa8d22-1fcb-433d-85d6-fe95ff9994de tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:31:03.223517 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6caa8d22-1fcb-433d-85d6-fe95ff9994de tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:31:03.224275 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6caa8d22-1fcb-433d-85d6-fe95ff9994de tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:31:03.224707 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6caa8d22-1fcb-433d-85d6-fe95ff9994de tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:31:03.365560 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-6caa8d22-1fcb-433d-85d6-fe95ff9994de tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:31:03.373105 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-6caa8d22-1fcb-433d-85d6-fe95ff9994de tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/889ca463-c9ab-4380-b6b1-fc95ddacda07" status: 200 len: 1681 microversion: 2.1 time: 0.161596 Mar 31 18:31:03.373681 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 542/1073] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:31:03 2022] GET /compute/v2.1/servers/889ca463-c9ab-4380-b6b1-fc95ddacda07 => generated 1681 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:31:04.391229 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-63d418cb-4890-4adf-8b0a-16d4bf34f339 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:31:04.391886 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-63d418cb-4890-4adf-8b0a-16d4bf34f339 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 889ca463-c9ab-4380-b6b1-fc95ddacda07] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:31:04.399214 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-63d418cb-4890-4adf-8b0a-16d4bf34f339 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:31:04.399688 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-63d418cb-4890-4adf-8b0a-16d4bf34f339 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:31:04.400473 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-63d418cb-4890-4adf-8b0a-16d4bf34f339 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:31:04.400905 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-63d418cb-4890-4adf-8b0a-16d4bf34f339 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:31:04.548373 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-63d418cb-4890-4adf-8b0a-16d4bf34f339 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:31:04.555906 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-63d418cb-4890-4adf-8b0a-16d4bf34f339 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/889ca463-c9ab-4380-b6b1-fc95ddacda07" status: 200 len: 1681 microversion: 2.1 time: 0.169185 Mar 31 18:31:04.556481 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 532/1074] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:31:04 2022] GET /compute/v2.1/servers/889ca463-c9ab-4380-b6b1-fc95ddacda07 => generated 1681 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:31:05.201810 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [req-ecad6df3-840f-4038-aab6-847b945fca9d req-b412f996-9833-4e58-bfc3-1e8bc22a6735 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "889ca463-c9ab-4380-b6b1-fc95ddacda07", "name": "network-vif-deleted", "tag": "d3323f32-595b-4f94-b81b-12a527728d9a"}]} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:31:05.211194 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-ecad6df3-840f-4038-aab6-847b945fca9d req-b412f996-9833-4e58-bfc3-1e8bc22a6735 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:31:05.211733 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-ecad6df3-840f-4038-aab6-847b945fca9d req-b412f996-9833-4e58-bfc3-1e8bc22a6735 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:31:05.224133 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.compute.server_external_events [req-ecad6df3-840f-4038-aab6-847b945fca9d req-b412f996-9833-4e58-bfc3-1e8bc22a6735 service nova] Creating event network-vif-deleted:d3323f32-595b-4f94-b81b-12a527728d9a for instance 889ca463-c9ab-4380-b6b1-fc95ddacda07 on hv-cinder-maste Mar 31 18:31:05.229375 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [req-ecad6df3-840f-4038-aab6-847b945fca9d req-b412f996-9833-4e58-bfc3-1e8bc22a6735 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095711 Mar 31 18:31:05.230587 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 543/1075] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:31:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 31 18:31:05.573405 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-0074de5b-5906-4b02-a768-dc62c9ae7452 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:31:05.574135 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-0074de5b-5906-4b02-a768-dc62c9ae7452 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 889ca463-c9ab-4380-b6b1-fc95ddacda07] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:31:05.582588 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0074de5b-5906-4b02-a768-dc62c9ae7452 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:31:05.582588 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0074de5b-5906-4b02-a768-dc62c9ae7452 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:31:05.583078 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0074de5b-5906-4b02-a768-dc62c9ae7452 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:31:05.583521 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0074de5b-5906-4b02-a768-dc62c9ae7452 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:31:05.617178 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0074de5b-5906-4b02-a768-dc62c9ae7452 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:31:05.617620 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0074de5b-5906-4b02-a768-dc62c9ae7452 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:31:05.618062 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.objects.instance [None req-0074de5b-5906-4b02-a768-dc62c9ae7452 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lazy-loading 'fault' on Instance uuid 889ca463-c9ab-4380-b6b1-fc95ddacda07 {{(pid=117539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 31 18:31:05.660071 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-0074de5b-5906-4b02-a768-dc62c9ae7452 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:31:05.667498 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-0074de5b-5906-4b02-a768-dc62c9ae7452 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/889ca463-c9ab-4380-b6b1-fc95ddacda07" status: 200 len: 1332 microversion: 2.1 time: 0.098171 Mar 31 18:31:05.668059 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 533/1076] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:31:05 2022] GET /compute/v2.1/servers/889ca463-c9ab-4380-b6b1-fc95ddacda07 => generated 1332 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:31:06.686294 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-ee1bc319-e513-4007-a5eb-d1c076a620a1 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:31:06.687033 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-ee1bc319-e513-4007-a5eb-d1c076a620a1 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 889ca463-c9ab-4380-b6b1-fc95ddacda07] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:31:06.693125 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-ee1bc319-e513-4007-a5eb-d1c076a620a1 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:31:06.693566 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-ee1bc319-e513-4007-a5eb-d1c076a620a1 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:31:06.694319 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-ee1bc319-e513-4007-a5eb-d1c076a620a1 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:31:06.694780 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-ee1bc319-e513-4007-a5eb-d1c076a620a1 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:31:06.707560 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.wsgi [None req-ee1bc319-e513-4007-a5eb-d1c076a620a1 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] HTTP exception thrown: Instance 889ca463-c9ab-4380-b6b1-fc95ddacda07 could not be found. Mar 31 18:31:06.708082 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-ee1bc319-e513-4007-a5eb-d1c076a620a1 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Returning 404 to user: Instance 889ca463-c9ab-4380-b6b1-fc95ddacda07 could not be found. {{(pid=117538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:31:06.708886 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-ee1bc319-e513-4007-a5eb-d1c076a620a1 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/889ca463-c9ab-4380-b6b1-fc95ddacda07" status: 404 len: 111 microversion: 2.1 time: 0.027283 Mar 31 18:31:06.709407 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 544/1077] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:31:06 2022] GET /compute/v2.1/servers/889ca463-c9ab-4380-b6b1-fc95ddacda07 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 31 18:31:06.718011 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-588a0782-63bb-42d7-b711-efc6b42879b1 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '.version_select at 0x7fa4d4536310>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:31:06.855452 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-588a0782-63bb-42d7-b711-efc6b42879b1 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1484986762" status: 202 len: 0 microversion: 2.1 time: 0.141295 Mar 31 18:31:06.856144 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 534/1078] 10.222.0.58 () {58 vars in 1220 bytes} [Thu Mar 31 18:31:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1484986762 => generated 0 bytes in 143 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 31 18:31:07.640728 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-6f5af506-ec92-4b53-ac78-ca5b56ea61cd tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Action: 'create', calling method: .version_select at 0x7fa4d44ab280>, body: {"keypair": {"name": "tempest-keypair-1747939233"}} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:31:07.654768 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.quota [None req-6f5af506-ec92-4b53-ac78-ca5b56ea61cd tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Getting quotas for project 7ae2325a87da4c5f8179a77fbd3d8748. Resources: {'key_pairs'} {{(pid=117538) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 31 18:31:07.658516 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.quota [None req-6f5af506-ec92-4b53-ac78-ca5b56ea61cd tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Getting quotas for user 211572ee7ab5422981422eaed6341657 and project 7ae2325a87da4c5f8179a77fbd3d8748. Resources: {'key_pairs'} {{(pid=117538) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 31 18:31:07.907580 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.quota [None req-6f5af506-ec92-4b53-ac78-ca5b56ea61cd tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Getting quotas for project 7ae2325a87da4c5f8179a77fbd3d8748. Resources: {'key_pairs'} {{(pid=117538) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 31 18:31:07.911362 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.quota [None req-6f5af506-ec92-4b53-ac78-ca5b56ea61cd tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Getting quotas for user 211572ee7ab5422981422eaed6341657 and project 7ae2325a87da4c5f8179a77fbd3d8748. Resources: {'key_pairs'} {{(pid=117538) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 31 18:31:07.925275 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-6f5af506-ec92-4b53-ac78-ca5b56ea61cd tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 2305 microversion: 2.1 time: 0.288455 Mar 31 18:31:07.925884 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 545/1079] 10.222.0.58 () {60 vars in 1157 bytes} [Thu Mar 31 18:31:07 2022] POST /compute/v2.1/os-keypairs => generated 2305 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:31:10.394987 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-1d179fb8-f3f0-4027-8925-d6af65a3ca5e tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1470120770", "imageRef": "6241b999-6f6d-4076-88bc-345fa7386256", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "48b6e4a0-767f-4f89-81e1-af0f127e9429"}], "security_groups": [{"name": "tempest-securitygroup--690453291"}], "key_name": "tempest-keypair-1747939233", "user_data": "}} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:31:10.497705 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.network.neutron [None req-1d179fb8-f3f0-4027-8925-d6af65a3ca5e tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] validate_networks() for [('48b6e4a0-767f-4f89-81e1-af0f127e9429', None, None, None, None, None)] {{(pid=117539) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 31 18:31:10.867931 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.virt.hardware [None req-1d179fb8-f3f0-4027-8925-d6af65a3ca5e tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Flavor limits 0:0:0 {{(pid=117539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 31 18:31:10.868369 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.virt.hardware [None req-1d179fb8-f3f0-4027-8925-d6af65a3ca5e tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Image limits 0:0:0 {{(pid=117539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 31 18:31:10.868836 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.virt.hardware [None req-1d179fb8-f3f0-4027-8925-d6af65a3ca5e tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Flavor pref 0:0:0 {{(pid=117539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 31 18:31:10.869230 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.virt.hardware [None req-1d179fb8-f3f0-4027-8925-d6af65a3ca5e tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Image pref 0:0:0 {{(pid=117539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 31 18:31:10.869658 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.virt.hardware [None req-1d179fb8-f3f0-4027-8925-d6af65a3ca5e tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117539) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 31 18:31:10.878303 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1d179fb8-f3f0-4027-8925-d6af65a3ca5e tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:31:10.878798 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1d179fb8-f3f0-4027-8925-d6af65a3ca5e tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:31:10.879573 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1d179fb8-f3f0-4027-8925-d6af65a3ca5e tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:31:10.880030 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-1d179fb8-f3f0-4027-8925-d6af65a3ca5e tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:31:10.896897 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.quota [None req-1d179fb8-f3f0-4027-8925-d6af65a3ca5e tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Getting quotas for project 7ae2325a87da4c5f8179a77fbd3d8748. Resources: {'instances', 'ram', 'cores'} {{(pid=117539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 31 18:31:10.900886 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.quota [None req-1d179fb8-f3f0-4027-8925-d6af65a3ca5e tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Getting quotas for user 211572ee7ab5422981422eaed6341657 and project 7ae2325a87da4c5f8179a77fbd3d8748. Resources: {'instances', 'ram', 'cores'} {{(pid=117539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 31 18:31:10.912510 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-1d179fb8-f3f0-4027-8925-d6af65a3ca5e tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Going to run 1 instances... {{(pid=117539) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 31 18:31:10.914804 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-1d179fb8-f3f0-4027-8925-d6af65a3ca5e tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 86bda241-c7e6-482d-aacf-2fd3bd226e89] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6241b999-6f6d-4076-88bc-345fa7386256',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117539) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 31 18:31:11.060273 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-1d179fb8-f3f0-4027-8925-d6af65a3ca5e tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.669962 Mar 31 18:31:11.060998 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 535/1080] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Mar 31 18:31:10 2022] POST /compute/v2.1/servers => generated 401 bytes in 672 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 31 18:31:11.072828 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-ed8428c5-d517-4a59-b0ad-0fc6ca6db77e tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:31:11.073420 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-ed8428c5-d517-4a59-b0ad-0fc6ca6db77e tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 86bda241-c7e6-482d-aacf-2fd3bd226e89] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:31:11.128850 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-ed8428c5-d517-4a59-b0ad-0fc6ca6db77e tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:31:11.135384 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-ed8428c5-d517-4a59-b0ad-0fc6ca6db77e tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/86bda241-c7e6-482d-aacf-2fd3bd226e89" status: 200 len: 1242 microversion: 2.1 time: 0.066934 Mar 31 18:31:11.135940 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 546/1081] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:31:11 2022] GET /compute/v2.1/servers/86bda241-c7e6-482d-aacf-2fd3bd226e89 => generated 1242 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:31:12.154255 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-025c1f48-42d2-482e-8fe4-7ade1f7383f7 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:31:12.154945 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-025c1f48-42d2-482e-8fe4-7ade1f7383f7 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 86bda241-c7e6-482d-aacf-2fd3bd226e89] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:31:12.208600 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-025c1f48-42d2-482e-8fe4-7ade1f7383f7 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:31:12.215207 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-025c1f48-42d2-482e-8fe4-7ade1f7383f7 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/86bda241-c7e6-482d-aacf-2fd3bd226e89" status: 200 len: 1242 microversion: 2.1 time: 0.065906 Mar 31 18:31:12.215794 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 536/1082] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:31:12 2022] GET /compute/v2.1/servers/86bda241-c7e6-482d-aacf-2fd3bd226e89 => generated 1242 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:31:13.232718 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-3f2cf675-60aa-4c5c-8c35-4b47a29c9076 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:31:13.233326 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-3f2cf675-60aa-4c5c-8c35-4b47a29c9076 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 86bda241-c7e6-482d-aacf-2fd3bd226e89] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:31:13.240431 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3f2cf675-60aa-4c5c-8c35-4b47a29c9076 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:31:13.240974 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3f2cf675-60aa-4c5c-8c35-4b47a29c9076 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:31:13.241736 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3f2cf675-60aa-4c5c-8c35-4b47a29c9076 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:31:13.242168 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3f2cf675-60aa-4c5c-8c35-4b47a29c9076 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:31:13.303047 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-3f2cf675-60aa-4c5c-8c35-4b47a29c9076 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:31:13.310264 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-3f2cf675-60aa-4c5c-8c35-4b47a29c9076 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/86bda241-c7e6-482d-aacf-2fd3bd226e89" status: 200 len: 1294 microversion: 2.1 time: 0.081462 Mar 31 18:31:13.310782 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 547/1083] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:31:13 2022] GET /compute/v2.1/servers/86bda241-c7e6-482d-aacf-2fd3bd226e89 => generated 1294 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:31:14.327513 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-8fefcaa3-f2bf-4e2e-b351-2033b808d7e0 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:31:14.328130 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-8fefcaa3-f2bf-4e2e-b351-2033b808d7e0 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 86bda241-c7e6-482d-aacf-2fd3bd226e89] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:31:14.335192 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-8fefcaa3-f2bf-4e2e-b351-2033b808d7e0 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:31:14.335640 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-8fefcaa3-f2bf-4e2e-b351-2033b808d7e0 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:31:14.336413 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-8fefcaa3-f2bf-4e2e-b351-2033b808d7e0 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:31:14.336843 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-8fefcaa3-f2bf-4e2e-b351-2033b808d7e0 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:31:14.487656 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-8fefcaa3-f2bf-4e2e-b351-2033b808d7e0 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:31:14.495263 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-8fefcaa3-f2bf-4e2e-b351-2033b808d7e0 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/86bda241-c7e6-482d-aacf-2fd3bd226e89" status: 200 len: 1367 microversion: 2.1 time: 0.171714 Mar 31 18:31:14.499084 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 537/1084] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:31:14 2022] GET /compute/v2.1/servers/86bda241-c7e6-482d-aacf-2fd3bd226e89 => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:31:15.318466 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [req-5907910d-aefb-4ee3-903a-433575d8ebbf req-766db814-1f6b-469b-8b2d-c655b6646552 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86bda241-c7e6-482d-aacf-2fd3bd226e89", "tag": "37333cba-6d73-4897-afb4-fcf3b7924967"}]} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:31:15.333568 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-5907910d-aefb-4ee3-903a-433575d8ebbf req-766db814-1f6b-469b-8b2d-c655b6646552 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:31:15.334059 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-5907910d-aefb-4ee3-903a-433575d8ebbf req-766db814-1f6b-469b-8b2d-c655b6646552 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:31:15.347171 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.compute.server_external_events [req-5907910d-aefb-4ee3-903a-433575d8ebbf req-766db814-1f6b-469b-8b2d-c655b6646552 service nova] Creating event network-changed:37333cba-6d73-4897-afb4-fcf3b7924967 for instance 86bda241-c7e6-482d-aacf-2fd3bd226e89 on hv-cinder-maste Mar 31 18:31:15.352569 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [req-5907910d-aefb-4ee3-903a-433575d8ebbf req-766db814-1f6b-469b-8b2d-c655b6646552 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047940 Mar 31 18:31:15.353174 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 548/1085] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:31:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:31:15.513236 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-2f103076-98f7-45b1-ab3b-0e24665ab633 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:31:15.513851 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-2f103076-98f7-45b1-ab3b-0e24665ab633 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 86bda241-c7e6-482d-aacf-2fd3bd226e89] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:31:15.521121 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-2f103076-98f7-45b1-ab3b-0e24665ab633 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:31:15.521569 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-2f103076-98f7-45b1-ab3b-0e24665ab633 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:31:15.522341 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-2f103076-98f7-45b1-ab3b-0e24665ab633 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:31:15.522811 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-2f103076-98f7-45b1-ab3b-0e24665ab633 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:31:15.665500 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-2f103076-98f7-45b1-ab3b-0e24665ab633 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:31:15.674522 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-2f103076-98f7-45b1-ab3b-0e24665ab633 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/86bda241-c7e6-482d-aacf-2fd3bd226e89" status: 200 len: 1367 microversion: 2.1 time: 0.165065 Mar 31 18:31:15.675147 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 538/1086] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:31:15 2022] GET /compute/v2.1/servers/86bda241-c7e6-482d-aacf-2fd3bd226e89 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:31:16.693420 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-17474c77-462d-4465-9e42-fb18cb0de90e tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:31:16.694106 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-17474c77-462d-4465-9e42-fb18cb0de90e tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 86bda241-c7e6-482d-aacf-2fd3bd226e89] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:31:16.700662 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-17474c77-462d-4465-9e42-fb18cb0de90e tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:31:16.701135 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-17474c77-462d-4465-9e42-fb18cb0de90e tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:31:16.701907 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-17474c77-462d-4465-9e42-fb18cb0de90e tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:31:16.702338 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-17474c77-462d-4465-9e42-fb18cb0de90e tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:31:16.846384 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-17474c77-462d-4465-9e42-fb18cb0de90e tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:31:16.853916 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-17474c77-462d-4465-9e42-fb18cb0de90e tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/86bda241-c7e6-482d-aacf-2fd3bd226e89" status: 200 len: 1367 microversion: 2.1 time: 0.167055 Mar 31 18:31:16.854488 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 549/1087] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:31:16 2022] GET /compute/v2.1/servers/86bda241-c7e6-482d-aacf-2fd3bd226e89 => generated 1367 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:31:17.872288 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-6a3f7a95-4ac7-43dc-b8bf-ffa7a65f5545 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:31:17.872916 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-6a3f7a95-4ac7-43dc-b8bf-ffa7a65f5545 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 86bda241-c7e6-482d-aacf-2fd3bd226e89] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:31:17.879898 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-6a3f7a95-4ac7-43dc-b8bf-ffa7a65f5545 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:31:17.880332 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-6a3f7a95-4ac7-43dc-b8bf-ffa7a65f5545 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:31:17.881083 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-6a3f7a95-4ac7-43dc-b8bf-ffa7a65f5545 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:31:17.881509 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-6a3f7a95-4ac7-43dc-b8bf-ffa7a65f5545 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:31:18.014679 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-6a3f7a95-4ac7-43dc-b8bf-ffa7a65f5545 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:31:18.023027 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-6a3f7a95-4ac7-43dc-b8bf-ffa7a65f5545 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/86bda241-c7e6-482d-aacf-2fd3bd226e89" status: 200 len: 1367 microversion: 2.1 time: 0.154727 Mar 31 18:31:18.023592 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 539/1088] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:31:17 2022] GET /compute/v2.1/servers/86bda241-c7e6-482d-aacf-2fd3bd226e89 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:31:19.040967 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-bb027aec-93c0-4ea7-8c77-eb89b693274a tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:31:19.041568 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-bb027aec-93c0-4ea7-8c77-eb89b693274a tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 86bda241-c7e6-482d-aacf-2fd3bd226e89] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:31:19.048679 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-bb027aec-93c0-4ea7-8c77-eb89b693274a tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:31:19.049153 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-bb027aec-93c0-4ea7-8c77-eb89b693274a tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:31:19.050133 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-bb027aec-93c0-4ea7-8c77-eb89b693274a tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:31:19.050562 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-bb027aec-93c0-4ea7-8c77-eb89b693274a tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:31:19.197148 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-bb027aec-93c0-4ea7-8c77-eb89b693274a tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:31:19.206003 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-bb027aec-93c0-4ea7-8c77-eb89b693274a tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/86bda241-c7e6-482d-aacf-2fd3bd226e89" status: 200 len: 1367 microversion: 2.1 time: 0.169119 Mar 31 18:31:19.206582 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 550/1089] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:31:19 2022] GET /compute/v2.1/servers/86bda241-c7e6-482d-aacf-2fd3bd226e89 => generated 1367 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:31:20.223300 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-62912168-1989-407d-9466-b547d49f2ade tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:31:20.223896 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-62912168-1989-407d-9466-b547d49f2ade tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 86bda241-c7e6-482d-aacf-2fd3bd226e89] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:31:20.230050 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-62912168-1989-407d-9466-b547d49f2ade tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:31:20.230489 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-62912168-1989-407d-9466-b547d49f2ade tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:31:20.231442 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-62912168-1989-407d-9466-b547d49f2ade tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:31:20.231879 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-62912168-1989-407d-9466-b547d49f2ade tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:31:20.368092 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-62912168-1989-407d-9466-b547d49f2ade tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:31:20.375529 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-62912168-1989-407d-9466-b547d49f2ade tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/86bda241-c7e6-482d-aacf-2fd3bd226e89" status: 200 len: 1367 microversion: 2.1 time: 0.156712 Mar 31 18:31:20.376104 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 540/1090] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:31:20 2022] GET /compute/v2.1/servers/86bda241-c7e6-482d-aacf-2fd3bd226e89 => generated 1367 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:31:21.392987 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-14490587-f3c4-4d22-8f70-af4b8b3de0c5 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:31:21.393535 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-14490587-f3c4-4d22-8f70-af4b8b3de0c5 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 86bda241-c7e6-482d-aacf-2fd3bd226e89] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:31:21.399966 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-14490587-f3c4-4d22-8f70-af4b8b3de0c5 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:31:21.400414 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-14490587-f3c4-4d22-8f70-af4b8b3de0c5 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:31:21.401185 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-14490587-f3c4-4d22-8f70-af4b8b3de0c5 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:31:21.401898 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-14490587-f3c4-4d22-8f70-af4b8b3de0c5 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:31:21.553521 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-14490587-f3c4-4d22-8f70-af4b8b3de0c5 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:31:21.561228 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-14490587-f3c4-4d22-8f70-af4b8b3de0c5 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/86bda241-c7e6-482d-aacf-2fd3bd226e89" status: 200 len: 1367 microversion: 2.1 time: 0.172943 Mar 31 18:31:21.561813 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 551/1091] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:31:21 2022] GET /compute/v2.1/servers/86bda241-c7e6-482d-aacf-2fd3bd226e89 => generated 1367 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:31:21.584846 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [req-db6ae457-9097-4fab-91b6-a65ea719b51f req-489a920e-5a89-442e-b3f0-ab3a3b7111df service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86bda241-c7e6-482d-aacf-2fd3bd226e89", "name": "network-vif-plugged", "status": "completed", "tag": "37333cba-6d73-4897-afb4-fcf3b7924967"}]} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:31:21.592751 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-db6ae457-9097-4fab-91b6-a65ea719b51f req-489a920e-5a89-442e-b3f0-ab3a3b7111df service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:31:21.593184 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-db6ae457-9097-4fab-91b6-a65ea719b51f req-489a920e-5a89-442e-b3f0-ab3a3b7111df service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:31:21.604373 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.compute.server_external_events [req-db6ae457-9097-4fab-91b6-a65ea719b51f req-489a920e-5a89-442e-b3f0-ab3a3b7111df service nova] Creating event network-vif-plugged:37333cba-6d73-4897-afb4-fcf3b7924967 for instance 86bda241-c7e6-482d-aacf-2fd3bd226e89 on hv-cinder-maste Mar 31 18:31:21.610272 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [req-db6ae457-9097-4fab-91b6-a65ea719b51f req-489a920e-5a89-442e-b3f0-ab3a3b7111df service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089618 Mar 31 18:31:21.610909 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 541/1092] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:31:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:31:22.579808 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-df3a63be-f96d-42f3-b958-d84a590f0ae1 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:31:22.580395 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-df3a63be-f96d-42f3-b958-d84a590f0ae1 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 86bda241-c7e6-482d-aacf-2fd3bd226e89] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:31:22.586838 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-df3a63be-f96d-42f3-b958-d84a590f0ae1 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:31:22.587290 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-df3a63be-f96d-42f3-b958-d84a590f0ae1 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:31:22.588078 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-df3a63be-f96d-42f3-b958-d84a590f0ae1 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:31:22.588510 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-df3a63be-f96d-42f3-b958-d84a590f0ae1 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:31:22.724061 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-df3a63be-f96d-42f3-b958-d84a590f0ae1 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:31:22.731310 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-df3a63be-f96d-42f3-b958-d84a590f0ae1 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/86bda241-c7e6-482d-aacf-2fd3bd226e89" status: 200 len: 1367 microversion: 2.1 time: 0.156336 Mar 31 18:31:22.731870 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 552/1093] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:31:22 2022] GET /compute/v2.1/servers/86bda241-c7e6-482d-aacf-2fd3bd226e89 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:31:23.750388 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-0f0f3a4d-8a6d-4bf6-b726-4a5ac58c88b9 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:31:23.751141 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-0f0f3a4d-8a6d-4bf6-b726-4a5ac58c88b9 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 86bda241-c7e6-482d-aacf-2fd3bd226e89] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:31:23.757377 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0f0f3a4d-8a6d-4bf6-b726-4a5ac58c88b9 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:31:23.757817 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0f0f3a4d-8a6d-4bf6-b726-4a5ac58c88b9 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:31:23.758566 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0f0f3a4d-8a6d-4bf6-b726-4a5ac58c88b9 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:31:23.759024 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0f0f3a4d-8a6d-4bf6-b726-4a5ac58c88b9 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:31:23.895143 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-0f0f3a4d-8a6d-4bf6-b726-4a5ac58c88b9 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:31:23.902775 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-0f0f3a4d-8a6d-4bf6-b726-4a5ac58c88b9 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/86bda241-c7e6-482d-aacf-2fd3bd226e89" status: 200 len: 1557 microversion: 2.1 time: 0.157548 Mar 31 18:31:23.903330 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 542/1094] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:31:23 2022] GET /compute/v2.1/servers/86bda241-c7e6-482d-aacf-2fd3bd226e89 => generated 1557 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:31:23.919044 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-8d7abeb7-d108-4b6d-8aeb-af3451524460 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:31:23.919612 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-8d7abeb7-d108-4b6d-8aeb-af3451524460 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 86bda241-c7e6-482d-aacf-2fd3bd226e89] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:31:23.925794 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8d7abeb7-d108-4b6d-8aeb-af3451524460 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:31:23.926246 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8d7abeb7-d108-4b6d-8aeb-af3451524460 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:31:23.927055 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8d7abeb7-d108-4b6d-8aeb-af3451524460 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:31:23.927489 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8d7abeb7-d108-4b6d-8aeb-af3451524460 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:31:24.008040 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-8d7abeb7-d108-4b6d-8aeb-af3451524460 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/86bda241-c7e6-482d-aacf-2fd3bd226e89/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092912 Mar 31 18:31:24.008634 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 553/1095] 10.222.0.58 () {58 vars in 1274 bytes} [Thu Mar 31 18:31:23 2022] GET /compute/v2.1/servers/86bda241-c7e6-482d-aacf-2fd3bd226e89/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:31:25.327259 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [req-3bcdf67a-8d9a-411f-aa02-37b7722c4293 req-7c7830c5-d3ce-43c5-b0ce-72609245d5c3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "86bda241-c7e6-482d-aacf-2fd3bd226e89", "tag": "37333cba-6d73-4897-afb4-fcf3b7924967"}]} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:31:25.335744 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-3bcdf67a-8d9a-411f-aa02-37b7722c4293 req-7c7830c5-d3ce-43c5-b0ce-72609245d5c3 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:31:25.336176 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-3bcdf67a-8d9a-411f-aa02-37b7722c4293 req-7c7830c5-d3ce-43c5-b0ce-72609245d5c3 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:31:25.347303 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.compute.server_external_events [req-3bcdf67a-8d9a-411f-aa02-37b7722c4293 req-7c7830c5-d3ce-43c5-b0ce-72609245d5c3 service nova] Creating event network-changed:37333cba-6d73-4897-afb4-fcf3b7924967 for instance 86bda241-c7e6-482d-aacf-2fd3bd226e89 on hv-cinder-maste Mar 31 18:31:25.352551 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [req-3bcdf67a-8d9a-411f-aa02-37b7722c4293 req-7c7830c5-d3ce-43c5-b0ce-72609245d5c3 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084091 Mar 31 18:31:25.353236 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 543/1096] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:31:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:32:29.641036 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 31 18:32:29.641655 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: Thu Mar 31 18:32:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 31 18:32:40.293055 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-6631cdbb-8e61-451b-9260-0aed5f601e58 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:32:40.293715 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-6631cdbb-8e61-451b-9260-0aed5f601e58 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 86bda241-c7e6-482d-aacf-2fd3bd226e89] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:32:40.299643 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6631cdbb-8e61-451b-9260-0aed5f601e58 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:32:40.300083 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6631cdbb-8e61-451b-9260-0aed5f601e58 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:32:40.300905 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6631cdbb-8e61-451b-9260-0aed5f601e58 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:32:40.301345 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6631cdbb-8e61-451b-9260-0aed5f601e58 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:32:40.323748 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-6631cdbb-8e61-451b-9260-0aed5f601e58 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/86bda241-c7e6-482d-aacf-2fd3bd226e89/ips" status: 200 len: 150 microversion: 2.1 time: 0.035778 Mar 31 18:32:40.324230 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 554/1097] 10.222.0.58 () {58 vars in 1247 bytes} [Thu Mar 31 18:32:40 2022] GET /compute/v2.1/servers/86bda241-c7e6-482d-aacf-2fd3bd226e89/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:32:43.086075 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-9e1c47ee-89af-4fa4-8097-94774248d294 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "257f77c8-0ebe-4c96-9d24-194a9e30ec15"}} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:32:43.087214 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-9e1c47ee-89af-4fa4-8097-94774248d294 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 86bda241-c7e6-482d-aacf-2fd3bd226e89] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:32:43.093808 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9e1c47ee-89af-4fa4-8097-94774248d294 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:32:43.094241 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9e1c47ee-89af-4fa4-8097-94774248d294 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:32:43.095024 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9e1c47ee-89af-4fa4-8097-94774248d294 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:32:43.095445 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-9e1c47ee-89af-4fa4-8097-94774248d294 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:32:43.963065 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-9e1c47ee-89af-4fa4-8097-94774248d294 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "POST /compute/v2.1/servers/86bda241-c7e6-482d-aacf-2fd3bd226e89/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.882477 Mar 31 18:32:43.963668 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 544/1098] 10.222.0.58 () {60 vars in 1322 bytes} [Thu Mar 31 18:32:43 2022] POST /compute/v2.1/servers/86bda241-c7e6-482d-aacf-2fd3bd226e89/os-volume_attachments => generated 194 bytes in 884 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:32:52.593416 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-19ac04b0-c599-4d6a-84af-ee5f0127fe06 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:32:52.598514 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-19ac04b0-c599-4d6a-84af-ee5f0127fe06 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 86bda241-c7e6-482d-aacf-2fd3bd226e89] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:32:52.600507 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-19ac04b0-c599-4d6a-84af-ee5f0127fe06 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:32:52.600948 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-19ac04b0-c599-4d6a-84af-ee5f0127fe06 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:32:52.601724 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-19ac04b0-c599-4d6a-84af-ee5f0127fe06 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:32:52.602148 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-19ac04b0-c599-4d6a-84af-ee5f0127fe06 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:32:52.681035 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.objects.instance [None req-19ac04b0-c599-4d6a-84af-ee5f0127fe06 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lazy-loading 'services' on Instance uuid 86bda241-c7e6-482d-aacf-2fd3bd226e89 {{(pid=117538) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 31 18:32:52.960879 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-19ac04b0-c599-4d6a-84af-ee5f0127fe06 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "DELETE /compute/v2.1/servers/86bda241-c7e6-482d-aacf-2fd3bd226e89/os-volume_attachments/257f77c8-0ebe-4c96-9d24-194a9e30ec15" status: 202 len: 0 microversion: 2.1 time: 0.371365 Mar 31 18:32:52.961465 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 555/1099] 10.222.0.58 () {58 vars in 1415 bytes} [Thu Mar 31 18:32:52 2022] DELETE /compute/v2.1/servers/86bda241-c7e6-482d-aacf-2fd3bd226e89/os-volume_attachments/257f77c8-0ebe-4c96-9d24-194a9e30ec15 => generated 0 bytes in 373 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 31 18:32:52.972055 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-af1210d2-ad34-49af-b53d-076e0567bf80 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:32:52.974020 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-af1210d2-ad34-49af-b53d-076e0567bf80 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 86bda241-c7e6-482d-aacf-2fd3bd226e89] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:32:52.980368 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-af1210d2-ad34-49af-b53d-076e0567bf80 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:32:52.985805 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-af1210d2-ad34-49af-b53d-076e0567bf80 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:32:52.985805 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-af1210d2-ad34-49af-b53d-076e0567bf80 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:32:52.985805 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-af1210d2-ad34-49af-b53d-076e0567bf80 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:32:53.011800 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-af1210d2-ad34-49af-b53d-076e0567bf80 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/86bda241-c7e6-482d-aacf-2fd3bd226e89/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045493 Mar 31 18:32:53.012366 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 545/1100] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Mar 31 18:32:52 2022] GET /compute/v2.1/servers/86bda241-c7e6-482d-aacf-2fd3bd226e89/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:32:54.025128 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-3f45d806-65f3-4edc-ab37-29220728fa27 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:32:54.026439 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-3f45d806-65f3-4edc-ab37-29220728fa27 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 86bda241-c7e6-482d-aacf-2fd3bd226e89] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:32:54.033106 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3f45d806-65f3-4edc-ab37-29220728fa27 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:32:54.033548 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3f45d806-65f3-4edc-ab37-29220728fa27 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:32:54.034311 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3f45d806-65f3-4edc-ab37-29220728fa27 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:32:54.034777 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-3f45d806-65f3-4edc-ab37-29220728fa27 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:32:54.063781 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-3f45d806-65f3-4edc-ab37-29220728fa27 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/86bda241-c7e6-482d-aacf-2fd3bd226e89/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043395 Mar 31 18:32:54.064349 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 556/1101] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Mar 31 18:32:54 2022] GET /compute/v2.1/servers/86bda241-c7e6-482d-aacf-2fd3bd226e89/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:32:55.075502 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-3ea5a7b1-230f-44ba-8b98-7c2e4bd07a48 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:32:55.076405 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-3ea5a7b1-230f-44ba-8b98-7c2e4bd07a48 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 86bda241-c7e6-482d-aacf-2fd3bd226e89] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:32:55.083347 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3ea5a7b1-230f-44ba-8b98-7c2e4bd07a48 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:32:55.083784 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3ea5a7b1-230f-44ba-8b98-7c2e4bd07a48 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:32:55.084532 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3ea5a7b1-230f-44ba-8b98-7c2e4bd07a48 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:32:55.084952 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3ea5a7b1-230f-44ba-8b98-7c2e4bd07a48 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:32:55.113018 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-3ea5a7b1-230f-44ba-8b98-7c2e4bd07a48 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/86bda241-c7e6-482d-aacf-2fd3bd226e89/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041596 Mar 31 18:32:55.113569 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 546/1102] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Mar 31 18:32:55 2022] GET /compute/v2.1/servers/86bda241-c7e6-482d-aacf-2fd3bd226e89/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 31 18:32:55.170850 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-6159454b-9f68-4798-9bc9-fbb572b3ff1a tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:32:55.171391 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-6159454b-9f68-4798-9bc9-fbb572b3ff1a tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 86bda241-c7e6-482d-aacf-2fd3bd226e89] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:32:55.177934 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6159454b-9f68-4798-9bc9-fbb572b3ff1a tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:32:55.178388 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6159454b-9f68-4798-9bc9-fbb572b3ff1a tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:32:55.179195 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6159454b-9f68-4798-9bc9-fbb572b3ff1a tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:32:55.179653 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6159454b-9f68-4798-9bc9-fbb572b3ff1a tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:32:55.204134 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-6159454b-9f68-4798-9bc9-fbb572b3ff1a tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 86bda241-c7e6-482d-aacf-2fd3bd226e89] Going to try to terminate instance {{(pid=117538) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 31 18:32:55.623292 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-6159454b-9f68-4798-9bc9-fbb572b3ff1a tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "DELETE /compute/v2.1/servers/86bda241-c7e6-482d-aacf-2fd3bd226e89" status: 204 len: 0 microversion: 2.1 time: 0.456098 Mar 31 18:32:55.623867 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 557/1103] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Mar 31 18:32:55 2022] DELETE /compute/v2.1/servers/86bda241-c7e6-482d-aacf-2fd3bd226e89 => generated 0 bytes in 458 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 31 18:32:55.639407 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-19a19297-62fb-46e6-ac6f-93b6b992de76 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:32:55.640021 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-19a19297-62fb-46e6-ac6f-93b6b992de76 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 86bda241-c7e6-482d-aacf-2fd3bd226e89] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:32:55.646810 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-19a19297-62fb-46e6-ac6f-93b6b992de76 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:32:55.647259 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-19a19297-62fb-46e6-ac6f-93b6b992de76 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:32:55.648021 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-19a19297-62fb-46e6-ac6f-93b6b992de76 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:32:55.648477 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-19a19297-62fb-46e6-ac6f-93b6b992de76 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:32:55.786451 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-19a19297-62fb-46e6-ac6f-93b6b992de76 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:32:55.793778 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-19a19297-62fb-46e6-ac6f-93b6b992de76 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/86bda241-c7e6-482d-aacf-2fd3bd226e89" status: 200 len: 1682 microversion: 2.1 time: 0.158318 Mar 31 18:32:55.794338 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 547/1104] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:32:55 2022] GET /compute/v2.1/servers/86bda241-c7e6-482d-aacf-2fd3bd226e89 => generated 1682 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:32:56.812338 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-5882602c-8464-4792-86f6-37025c8b5fa3 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:32:56.813043 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-5882602c-8464-4792-86f6-37025c8b5fa3 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 86bda241-c7e6-482d-aacf-2fd3bd226e89] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:32:56.819973 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-5882602c-8464-4792-86f6-37025c8b5fa3 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:32:56.820414 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-5882602c-8464-4792-86f6-37025c8b5fa3 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:32:56.821172 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-5882602c-8464-4792-86f6-37025c8b5fa3 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:32:56.821600 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-5882602c-8464-4792-86f6-37025c8b5fa3 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:32:56.956265 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-5882602c-8464-4792-86f6-37025c8b5fa3 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:32:56.963557 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-5882602c-8464-4792-86f6-37025c8b5fa3 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/86bda241-c7e6-482d-aacf-2fd3bd226e89" status: 200 len: 1682 microversion: 2.1 time: 0.155458 Mar 31 18:32:56.964113 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 558/1105] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:32:56 2022] GET /compute/v2.1/servers/86bda241-c7e6-482d-aacf-2fd3bd226e89 => generated 1682 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:32:57.981358 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-be52b2e3-068e-4926-b4ba-efbbd9674210 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:32:57.981961 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-be52b2e3-068e-4926-b4ba-efbbd9674210 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 86bda241-c7e6-482d-aacf-2fd3bd226e89] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:32:57.988296 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-be52b2e3-068e-4926-b4ba-efbbd9674210 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:32:57.988727 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-be52b2e3-068e-4926-b4ba-efbbd9674210 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:32:57.989481 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-be52b2e3-068e-4926-b4ba-efbbd9674210 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:32:57.989904 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-be52b2e3-068e-4926-b4ba-efbbd9674210 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:32:58.138916 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-be52b2e3-068e-4926-b4ba-efbbd9674210 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:32:58.146750 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-be52b2e3-068e-4926-b4ba-efbbd9674210 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/86bda241-c7e6-482d-aacf-2fd3bd226e89" status: 200 len: 1682 microversion: 2.1 time: 0.169266 Mar 31 18:32:58.147623 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 548/1106] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:32:57 2022] GET /compute/v2.1/servers/86bda241-c7e6-482d-aacf-2fd3bd226e89 => generated 1682 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:32:58.695316 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [req-ac70ed05-41bc-4032-a634-2f3b2b89163d req-948d6033-d56c-45c7-a4c2-a725ca61524d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "86bda241-c7e6-482d-aacf-2fd3bd226e89", "name": "network-vif-deleted", "tag": "37333cba-6d73-4897-afb4-fcf3b7924967"}]} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:32:58.704710 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-ac70ed05-41bc-4032-a634-2f3b2b89163d req-948d6033-d56c-45c7-a4c2-a725ca61524d service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:32:58.705156 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-ac70ed05-41bc-4032-a634-2f3b2b89163d req-948d6033-d56c-45c7-a4c2-a725ca61524d service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:32:58.716190 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.compute.server_external_events [req-ac70ed05-41bc-4032-a634-2f3b2b89163d req-948d6033-d56c-45c7-a4c2-a725ca61524d service nova] Creating event network-vif-deleted:37333cba-6d73-4897-afb4-fcf3b7924967 for instance 86bda241-c7e6-482d-aacf-2fd3bd226e89 on hv-cinder-maste Mar 31 18:32:58.721652 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [req-ac70ed05-41bc-4032-a634-2f3b2b89163d req-948d6033-d56c-45c7-a4c2-a725ca61524d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030136 Mar 31 18:32:58.722653 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 559/1107] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:32:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:32:59.164376 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-365e388b-7c1d-47d4-aeb3-7ec9240f9cfa tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:32:59.164950 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-365e388b-7c1d-47d4-aeb3-7ec9240f9cfa tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 86bda241-c7e6-482d-aacf-2fd3bd226e89] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:32:59.171225 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-365e388b-7c1d-47d4-aeb3-7ec9240f9cfa tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:32:59.171684 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-365e388b-7c1d-47d4-aeb3-7ec9240f9cfa tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:32:59.172608 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-365e388b-7c1d-47d4-aeb3-7ec9240f9cfa tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:32:59.173184 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-365e388b-7c1d-47d4-aeb3-7ec9240f9cfa tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:32:59.204238 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-365e388b-7c1d-47d4-aeb3-7ec9240f9cfa tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:32:59.204682 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-365e388b-7c1d-47d4-aeb3-7ec9240f9cfa tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:32:59.205119 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.objects.instance [None req-365e388b-7c1d-47d4-aeb3-7ec9240f9cfa tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lazy-loading 'fault' on Instance uuid 86bda241-c7e6-482d-aacf-2fd3bd226e89 {{(pid=117539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 31 18:32:59.244101 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-365e388b-7c1d-47d4-aeb3-7ec9240f9cfa tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '211572ee7ab5422981422eaed6341657', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '7ae2325a87da4c5f8179a77fbd3d8748', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:32:59.251996 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-365e388b-7c1d-47d4-aeb3-7ec9240f9cfa tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/86bda241-c7e6-482d-aacf-2fd3bd226e89" status: 200 len: 1332 microversion: 2.1 time: 0.091654 Mar 31 18:32:59.252553 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 549/1108] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:32:59 2022] GET /compute/v2.1/servers/86bda241-c7e6-482d-aacf-2fd3bd226e89 => generated 1332 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:33:00.269747 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-87ae599c-e949-4057-8598-2a0f3315e07a tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:33:00.270346 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-87ae599c-e949-4057-8598-2a0f3315e07a tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 86bda241-c7e6-482d-aacf-2fd3bd226e89] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:33:00.276587 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-87ae599c-e949-4057-8598-2a0f3315e07a tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:33:00.277036 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-87ae599c-e949-4057-8598-2a0f3315e07a tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:33:00.277789 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-87ae599c-e949-4057-8598-2a0f3315e07a tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:33:00.278214 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-87ae599c-e949-4057-8598-2a0f3315e07a tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:33:00.291531 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.wsgi [None req-87ae599c-e949-4057-8598-2a0f3315e07a tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] HTTP exception thrown: Instance 86bda241-c7e6-482d-aacf-2fd3bd226e89 could not be found. Mar 31 18:33:00.292129 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-87ae599c-e949-4057-8598-2a0f3315e07a tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Returning 404 to user: Instance 86bda241-c7e6-482d-aacf-2fd3bd226e89 could not be found. {{(pid=117538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:33:00.292940 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-87ae599c-e949-4057-8598-2a0f3315e07a tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/86bda241-c7e6-482d-aacf-2fd3bd226e89" status: 404 len: 111 microversion: 2.1 time: 0.027955 Mar 31 18:33:00.293478 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 560/1109] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:33:00 2022] GET /compute/v2.1/servers/86bda241-c7e6-482d-aacf-2fd3bd226e89 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 31 18:33:00.302879 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-28fee432-67c5-43e2-a129-eb9918961e82 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '.version_select at 0x7fa4d4493160>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:33:00.395252 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-28fee432-67c5-43e2-a129-eb9918961e82 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1747939233" status: 202 len: 0 microversion: 2.1 time: 0.096457 Mar 31 18:33:00.395829 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 550/1110] 10.222.0.58 () {58 vars in 1220 bytes} [Thu Mar 31 18:33:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1747939233 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 31 18:33:02.515147 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-6e057777-6f26-4fce-a04f-265e3136a9ed tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:33:02.515674 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-6e057777-6f26-4fce-a04f-265e3136a9ed tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 86bda241-c7e6-482d-aacf-2fd3bd226e89] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:33:02.521971 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6e057777-6f26-4fce-a04f-265e3136a9ed tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:33:02.522414 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6e057777-6f26-4fce-a04f-265e3136a9ed tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:33:02.523231 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6e057777-6f26-4fce-a04f-265e3136a9ed tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:33:02.523657 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6e057777-6f26-4fce-a04f-265e3136a9ed tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:33:02.537187 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.wsgi [None req-6e057777-6f26-4fce-a04f-265e3136a9ed tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] HTTP exception thrown: Instance 86bda241-c7e6-482d-aacf-2fd3bd226e89 could not be found. Mar 31 18:33:02.537757 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-6e057777-6f26-4fce-a04f-265e3136a9ed tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Returning 404 to user: Instance 86bda241-c7e6-482d-aacf-2fd3bd226e89 could not be found. {{(pid=117538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:33:02.538553 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-6e057777-6f26-4fce-a04f-265e3136a9ed tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "DELETE /compute/v2.1/servers/86bda241-c7e6-482d-aacf-2fd3bd226e89" status: 404 len: 111 microversion: 2.1 time: 0.027275 Mar 31 18:33:02.539091 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 561/1111] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Mar 31 18:33:02 2022] DELETE /compute/v2.1/servers/86bda241-c7e6-482d-aacf-2fd3bd226e89 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 31 18:33:02.554036 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-f3c3f794-c353-4b1e-a82a-4db6fe8edf40 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:33:02.554657 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-f3c3f794-c353-4b1e-a82a-4db6fe8edf40 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 86bda241-c7e6-482d-aacf-2fd3bd226e89] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:33:02.562350 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-f3c3f794-c353-4b1e-a82a-4db6fe8edf40 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:33:02.562818 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-f3c3f794-c353-4b1e-a82a-4db6fe8edf40 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:33:02.563561 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-f3c3f794-c353-4b1e-a82a-4db6fe8edf40 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:33:02.563986 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-f3c3f794-c353-4b1e-a82a-4db6fe8edf40 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:33:02.576333 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.wsgi [None req-f3c3f794-c353-4b1e-a82a-4db6fe8edf40 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] HTTP exception thrown: Instance 86bda241-c7e6-482d-aacf-2fd3bd226e89 could not be found. Mar 31 18:33:02.576921 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-f3c3f794-c353-4b1e-a82a-4db6fe8edf40 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Returning 404 to user: Instance 86bda241-c7e6-482d-aacf-2fd3bd226e89 could not be found. {{(pid=117539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:33:02.577694 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-f3c3f794-c353-4b1e-a82a-4db6fe8edf40 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/86bda241-c7e6-482d-aacf-2fd3bd226e89" status: 404 len: 111 microversion: 2.1 time: 0.028031 Mar 31 18:33:02.578818 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 551/1112] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:33:02 2022] GET /compute/v2.1/servers/86bda241-c7e6-482d-aacf-2fd3bd226e89 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 31 18:33:03.814107 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-9c04873a-973d-4d1d-82ba-3a059e831a7c tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:33:03.814600 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-9c04873a-973d-4d1d-82ba-3a059e831a7c tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 889ca463-c9ab-4380-b6b1-fc95ddacda07] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:33:03.820940 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9c04873a-973d-4d1d-82ba-3a059e831a7c tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:33:03.821385 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9c04873a-973d-4d1d-82ba-3a059e831a7c tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:33:03.822147 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9c04873a-973d-4d1d-82ba-3a059e831a7c tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:33:03.822583 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9c04873a-973d-4d1d-82ba-3a059e831a7c tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:33:03.837722 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.wsgi [None req-9c04873a-973d-4d1d-82ba-3a059e831a7c tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] HTTP exception thrown: Instance 889ca463-c9ab-4380-b6b1-fc95ddacda07 could not be found. Mar 31 18:33:03.838306 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-9c04873a-973d-4d1d-82ba-3a059e831a7c tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Returning 404 to user: Instance 889ca463-c9ab-4380-b6b1-fc95ddacda07 could not be found. {{(pid=117538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:33:03.839163 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-9c04873a-973d-4d1d-82ba-3a059e831a7c tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "DELETE /compute/v2.1/servers/889ca463-c9ab-4380-b6b1-fc95ddacda07" status: 404 len: 111 microversion: 2.1 time: 0.029258 Mar 31 18:33:03.839689 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 562/1113] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Mar 31 18:33:03 2022] DELETE /compute/v2.1/servers/889ca463-c9ab-4380-b6b1-fc95ddacda07 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 31 18:33:03.848674 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-a89e7b41-39b6-49c8-bc5a-b05196e1fd36 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:33:03.849284 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-a89e7b41-39b6-49c8-bc5a-b05196e1fd36 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 889ca463-c9ab-4380-b6b1-fc95ddacda07] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:33:03.855547 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a89e7b41-39b6-49c8-bc5a-b05196e1fd36 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:33:03.855992 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a89e7b41-39b6-49c8-bc5a-b05196e1fd36 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:33:03.856748 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a89e7b41-39b6-49c8-bc5a-b05196e1fd36 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:33:03.857176 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a89e7b41-39b6-49c8-bc5a-b05196e1fd36 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:33:03.870575 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.wsgi [None req-a89e7b41-39b6-49c8-bc5a-b05196e1fd36 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] HTTP exception thrown: Instance 889ca463-c9ab-4380-b6b1-fc95ddacda07 could not be found. Mar 31 18:33:03.871182 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-a89e7b41-39b6-49c8-bc5a-b05196e1fd36 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Returning 404 to user: Instance 889ca463-c9ab-4380-b6b1-fc95ddacda07 could not be found. {{(pid=117539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:33:03.872018 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-a89e7b41-39b6-49c8-bc5a-b05196e1fd36 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/889ca463-c9ab-4380-b6b1-fc95ddacda07" status: 404 len: 111 microversion: 2.1 time: 0.027978 Mar 31 18:33:03.872538 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 552/1114] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:33:03 2022] GET /compute/v2.1/servers/889ca463-c9ab-4380-b6b1-fc95ddacda07 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 31 18:33:03.880613 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-9c054fac-aa36-4702-98da-c8d7303dee17 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:33:03.881106 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-9c054fac-aa36-4702-98da-c8d7303dee17 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 99e5e8ac-ddfc-4450-8900-3d66a7ac8910] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:33:03.886931 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9c054fac-aa36-4702-98da-c8d7303dee17 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:33:03.887372 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9c054fac-aa36-4702-98da-c8d7303dee17 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:33:03.888122 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9c054fac-aa36-4702-98da-c8d7303dee17 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:33:03.888547 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9c054fac-aa36-4702-98da-c8d7303dee17 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:33:03.901798 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.wsgi [None req-9c054fac-aa36-4702-98da-c8d7303dee17 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] HTTP exception thrown: Instance 99e5e8ac-ddfc-4450-8900-3d66a7ac8910 could not be found. Mar 31 18:33:03.902378 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-9c054fac-aa36-4702-98da-c8d7303dee17 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Returning 404 to user: Instance 99e5e8ac-ddfc-4450-8900-3d66a7ac8910 could not be found. {{(pid=117538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:33:03.903204 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-9c054fac-aa36-4702-98da-c8d7303dee17 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "DELETE /compute/v2.1/servers/99e5e8ac-ddfc-4450-8900-3d66a7ac8910" status: 404 len: 111 microversion: 2.1 time: 0.026406 Mar 31 18:33:03.903730 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 563/1115] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Mar 31 18:33:03 2022] DELETE /compute/v2.1/servers/99e5e8ac-ddfc-4450-8900-3d66a7ac8910 => generated 111 bytes in 27 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 31 18:33:03.912015 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-f838bdb7-2d4f-46b0-8a6b-02c9c5449c61 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:33:03.912617 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-f838bdb7-2d4f-46b0-8a6b-02c9c5449c61 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 99e5e8ac-ddfc-4450-8900-3d66a7ac8910] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:33:03.918496 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-f838bdb7-2d4f-46b0-8a6b-02c9c5449c61 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:33:03.918968 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-f838bdb7-2d4f-46b0-8a6b-02c9c5449c61 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:33:03.919712 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-f838bdb7-2d4f-46b0-8a6b-02c9c5449c61 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:33:03.920136 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-f838bdb7-2d4f-46b0-8a6b-02c9c5449c61 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:33:03.933576 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.wsgi [None req-f838bdb7-2d4f-46b0-8a6b-02c9c5449c61 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] HTTP exception thrown: Instance 99e5e8ac-ddfc-4450-8900-3d66a7ac8910 could not be found. Mar 31 18:33:03.934150 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-f838bdb7-2d4f-46b0-8a6b-02c9c5449c61 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Returning 404 to user: Instance 99e5e8ac-ddfc-4450-8900-3d66a7ac8910 could not be found. {{(pid=117539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:33:03.935509 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-f838bdb7-2d4f-46b0-8a6b-02c9c5449c61 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/99e5e8ac-ddfc-4450-8900-3d66a7ac8910" status: 404 len: 111 microversion: 2.1 time: 0.026733 Mar 31 18:33:03.936049 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 553/1116] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:33:03 2022] GET /compute/v2.1/servers/99e5e8ac-ddfc-4450-8900-3d66a7ac8910 => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 31 18:33:05.251922 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-d9b71614-1319-40a3-b182-feed42867209 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:33:05.252405 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-d9b71614-1319-40a3-b182-feed42867209 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 8d43f77a-cb85-4276-9bed-686f306ea21a] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:33:05.258555 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-d9b71614-1319-40a3-b182-feed42867209 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:33:05.273663 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-d9b71614-1319-40a3-b182-feed42867209 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:33:05.273663 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-d9b71614-1319-40a3-b182-feed42867209 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:33:05.273663 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-d9b71614-1319-40a3-b182-feed42867209 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:33:05.273663 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.wsgi [None req-d9b71614-1319-40a3-b182-feed42867209 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] HTTP exception thrown: Instance 8d43f77a-cb85-4276-9bed-686f306ea21a could not be found. Mar 31 18:33:05.274116 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-d9b71614-1319-40a3-b182-feed42867209 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Returning 404 to user: Instance 8d43f77a-cb85-4276-9bed-686f306ea21a could not be found. {{(pid=117538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:33:05.274703 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-d9b71614-1319-40a3-b182-feed42867209 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "DELETE /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a" status: 404 len: 111 microversion: 2.1 time: 0.026773 Mar 31 18:33:05.275485 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 564/1117] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Mar 31 18:33:05 2022] DELETE /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a => generated 111 bytes in 28 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 31 18:33:05.284030 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-a51216d9-1fb4-4325-99cb-77bd676185b6 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:33:05.284666 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-a51216d9-1fb4-4325-99cb-77bd676185b6 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] [instance: 8d43f77a-cb85-4276-9bed-686f306ea21a] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:33:05.291169 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a51216d9-1fb4-4325-99cb-77bd676185b6 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:33:05.291609 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a51216d9-1fb4-4325-99cb-77bd676185b6 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:33:05.292366 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a51216d9-1fb4-4325-99cb-77bd676185b6 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:33:05.292794 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-a51216d9-1fb4-4325-99cb-77bd676185b6 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:33:05.306211 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.wsgi [None req-a51216d9-1fb4-4325-99cb-77bd676185b6 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] HTTP exception thrown: Instance 8d43f77a-cb85-4276-9bed-686f306ea21a could not be found. Mar 31 18:33:05.306822 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-a51216d9-1fb4-4325-99cb-77bd676185b6 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] Returning 404 to user: Instance 8d43f77a-cb85-4276-9bed-686f306ea21a could not be found. {{(pid=117539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:33:05.307630 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-a51216d9-1fb4-4325-99cb-77bd676185b6 tempest-AttachVolumeNegativeTest-2061339577 tempest-AttachVolumeNegativeTest-2061339577-project] 10.222.0.58 "GET /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a" status: 404 len: 111 microversion: 2.1 time: 0.028185 Mar 31 18:33:05.308156 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 554/1118] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:33:05 2022] GET /compute/v2.1/servers/8d43f77a-cb85-4276-9bed-686f306ea21a => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 31 18:33:30.829150 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-e1cc3ee1-6c69-4e88-b26f-114a09fd9f86 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-522030015", "imageRef": "6241b999-6f6d-4076-88bc-345fa7386256", "flavorRef": "452", "networks": [{"uuid": "197de12b-9d63-43d4-82b6-c8da9ef22625"}]}} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:33:30.881302 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.network.neutron [None req-e1cc3ee1-6c69-4e88-b26f-114a09fd9f86 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] validate_networks() for [('197de12b-9d63-43d4-82b6-c8da9ef22625', None, None, None, None, None)] {{(pid=117538) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 31 18:33:31.263475 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.virt.hardware [None req-e1cc3ee1-6c69-4e88-b26f-114a09fd9f86 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Flavor limits 0:0:0 {{(pid=117538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 31 18:33:31.263906 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.virt.hardware [None req-e1cc3ee1-6c69-4e88-b26f-114a09fd9f86 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Image limits 0:0:0 {{(pid=117538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 31 18:33:31.264381 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.virt.hardware [None req-e1cc3ee1-6c69-4e88-b26f-114a09fd9f86 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Flavor pref 0:0:0 {{(pid=117538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 31 18:33:31.264789 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.virt.hardware [None req-e1cc3ee1-6c69-4e88-b26f-114a09fd9f86 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Image pref 0:0:0 {{(pid=117538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 31 18:33:31.265830 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.virt.hardware [None req-e1cc3ee1-6c69-4e88-b26f-114a09fd9f86 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 31 18:33:31.275421 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e1cc3ee1-6c69-4e88-b26f-114a09fd9f86 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:33:31.275855 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e1cc3ee1-6c69-4e88-b26f-114a09fd9f86 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:33:31.276665 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e1cc3ee1-6c69-4e88-b26f-114a09fd9f86 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:33:31.277120 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e1cc3ee1-6c69-4e88-b26f-114a09fd9f86 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:33:31.293415 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.quota [None req-e1cc3ee1-6c69-4e88-b26f-114a09fd9f86 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Getting quotas for project 0f2d961f71194831954c10d99bcd4e64. Resources: {'instances', 'ram', 'cores'} {{(pid=117538) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 31 18:33:31.297309 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.quota [None req-e1cc3ee1-6c69-4e88-b26f-114a09fd9f86 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Getting quotas for user 1cba9a710d9f4faeb9a267f284223dc0 and project 0f2d961f71194831954c10d99bcd4e64. Resources: {'instances', 'ram', 'cores'} {{(pid=117538) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 31 18:33:31.307859 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-e1cc3ee1-6c69-4e88-b26f-114a09fd9f86 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Going to run 1 instances... {{(pid=117538) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 31 18:33:31.310092 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-e1cc3ee1-6c69-4e88-b26f-114a09fd9f86 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] [instance: 7462d2ff-e093-4bfd-b223-def749c8175e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6241b999-6f6d-4076-88bc-345fa7386256',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117538) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 31 18:33:31.503531 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-e1cc3ee1-6c69-4e88-b26f-114a09fd9f86 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.678714 Mar 31 18:33:31.504414 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 565/1119] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Mar 31 18:33:30 2022] POST /compute/v2.1/servers => generated 380 bytes in 680 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 31 18:33:31.514481 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-19878e97-825e-4b9a-acf5-9be4ecc3cfc6 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:33:31.515070 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-19878e97-825e-4b9a-acf5-9be4ecc3cfc6 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] [instance: 7462d2ff-e093-4bfd-b223-def749c8175e] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:33:31.570887 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-19878e97-825e-4b9a-acf5-9be4ecc3cfc6 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cba9a710d9f4faeb9a267f284223dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d961f71194831954c10d99bcd4e64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:33:31.577406 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-19878e97-825e-4b9a-acf5-9be4ecc3cfc6 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] 10.222.0.58 "GET /compute/v2.1/servers/7462d2ff-e093-4bfd-b223-def749c8175e" status: 200 len: 1218 microversion: 2.1 time: 0.067024 Mar 31 18:33:31.578151 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 555/1120] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:33:31 2022] GET /compute/v2.1/servers/7462d2ff-e093-4bfd-b223-def749c8175e => generated 1218 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:33:32.595174 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-8c77e521-e430-412c-9cac-d148a946204e tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:33:32.595696 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-8c77e521-e430-412c-9cac-d148a946204e tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] [instance: 7462d2ff-e093-4bfd-b223-def749c8175e] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:33:32.651033 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-8c77e521-e430-412c-9cac-d148a946204e tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cba9a710d9f4faeb9a267f284223dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d961f71194831954c10d99bcd4e64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:33:32.658451 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-8c77e521-e430-412c-9cac-d148a946204e tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] 10.222.0.58 "GET /compute/v2.1/servers/7462d2ff-e093-4bfd-b223-def749c8175e" status: 200 len: 1218 microversion: 2.1 time: 0.068065 Mar 31 18:33:32.659042 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 566/1121] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:33:32 2022] GET /compute/v2.1/servers/7462d2ff-e093-4bfd-b223-def749c8175e => generated 1218 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:33:33.675795 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-097b1d8d-e1c6-41c5-b196-119371acf333 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:33:33.676454 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-097b1d8d-e1c6-41c5-b196-119371acf333 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] [instance: 7462d2ff-e093-4bfd-b223-def749c8175e] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:33:33.683790 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-097b1d8d-e1c6-41c5-b196-119371acf333 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:33:33.684239 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-097b1d8d-e1c6-41c5-b196-119371acf333 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:33:33.685003 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-097b1d8d-e1c6-41c5-b196-119371acf333 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:33:33.685439 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-097b1d8d-e1c6-41c5-b196-119371acf333 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:33:33.743780 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-097b1d8d-e1c6-41c5-b196-119371acf333 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cba9a710d9f4faeb9a267f284223dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d961f71194831954c10d99bcd4e64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:33:33.751247 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-097b1d8d-e1c6-41c5-b196-119371acf333 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] 10.222.0.58 "GET /compute/v2.1/servers/7462d2ff-e093-4bfd-b223-def749c8175e" status: 200 len: 1270 microversion: 2.1 time: 0.080097 Mar 31 18:33:33.751802 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 556/1122] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:33:33 2022] GET /compute/v2.1/servers/7462d2ff-e093-4bfd-b223-def749c8175e => generated 1270 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:33:34.768266 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-6dbfb199-d6fb-4cac-9fd5-b4a61ce0f2b2 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:33:34.768983 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-6dbfb199-d6fb-4cac-9fd5-b4a61ce0f2b2 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] [instance: 7462d2ff-e093-4bfd-b223-def749c8175e] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:33:34.775539 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6dbfb199-d6fb-4cac-9fd5-b4a61ce0f2b2 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:33:34.775990 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6dbfb199-d6fb-4cac-9fd5-b4a61ce0f2b2 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:33:34.776777 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6dbfb199-d6fb-4cac-9fd5-b4a61ce0f2b2 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:33:34.777194 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6dbfb199-d6fb-4cac-9fd5-b4a61ce0f2b2 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:33:34.972194 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-6dbfb199-d6fb-4cac-9fd5-b4a61ce0f2b2 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cba9a710d9f4faeb9a267f284223dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d961f71194831954c10d99bcd4e64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:33:34.979489 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-6dbfb199-d6fb-4cac-9fd5-b4a61ce0f2b2 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] 10.222.0.58 "GET /compute/v2.1/servers/7462d2ff-e093-4bfd-b223-def749c8175e" status: 200 len: 1318 microversion: 2.1 time: 0.215191 Mar 31 18:33:34.980089 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 567/1123] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:33:34 2022] GET /compute/v2.1/servers/7462d2ff-e093-4bfd-b223-def749c8175e => generated 1318 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:33:35.997155 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-5eeb60aa-a6c0-4bcc-9213-2e86e19c84a0 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:33:35.997802 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-5eeb60aa-a6c0-4bcc-9213-2e86e19c84a0 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] [instance: 7462d2ff-e093-4bfd-b223-def749c8175e] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:33:36.004679 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-5eeb60aa-a6c0-4bcc-9213-2e86e19c84a0 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:33:36.005118 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-5eeb60aa-a6c0-4bcc-9213-2e86e19c84a0 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:33:36.005867 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-5eeb60aa-a6c0-4bcc-9213-2e86e19c84a0 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:33:36.006293 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-5eeb60aa-a6c0-4bcc-9213-2e86e19c84a0 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:33:36.086158 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [req-e7660d07-2f38-4fa9-88b8-03157c4ef5cf req-0d20d62e-9a25-4721-927c-69d508fe1e87 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7462d2ff-e093-4bfd-b223-def749c8175e", "tag": "3f245005-1be9-4c70-b9bc-8dc2f82d8a7f"}]} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:33:36.097358 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-e7660d07-2f38-4fa9-88b8-03157c4ef5cf req-0d20d62e-9a25-4721-927c-69d508fe1e87 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:33:36.097902 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-e7660d07-2f38-4fa9-88b8-03157c4ef5cf req-0d20d62e-9a25-4721-927c-69d508fe1e87 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:33:36.110103 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.compute.server_external_events [req-e7660d07-2f38-4fa9-88b8-03157c4ef5cf req-0d20d62e-9a25-4721-927c-69d508fe1e87 service nova] Creating event network-changed:3f245005-1be9-4c70-b9bc-8dc2f82d8a7f for instance 7462d2ff-e093-4bfd-b223-def749c8175e on hv-cinder-maste Mar 31 18:33:36.115210 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [req-e7660d07-2f38-4fa9-88b8-03157c4ef5cf req-0d20d62e-9a25-4721-927c-69d508fe1e87 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033175 Mar 31 18:33:36.115891 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 568/1124] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:33:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 31 18:33:36.154388 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-5eeb60aa-a6c0-4bcc-9213-2e86e19c84a0 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cba9a710d9f4faeb9a267f284223dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d961f71194831954c10d99bcd4e64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:33:36.162347 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-5eeb60aa-a6c0-4bcc-9213-2e86e19c84a0 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] 10.222.0.58 "GET /compute/v2.1/servers/7462d2ff-e093-4bfd-b223-def749c8175e" status: 200 len: 1318 microversion: 2.1 time: 0.168962 Mar 31 18:33:36.163032 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 557/1125] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:33:35 2022] GET /compute/v2.1/servers/7462d2ff-e093-4bfd-b223-def749c8175e => generated 1318 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:33:37.180929 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-174f0f13-6b06-415a-b956-554026e5aafd tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:33:37.181617 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-174f0f13-6b06-415a-b956-554026e5aafd tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] [instance: 7462d2ff-e093-4bfd-b223-def749c8175e] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:33:37.187770 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-174f0f13-6b06-415a-b956-554026e5aafd tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:33:37.188204 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-174f0f13-6b06-415a-b956-554026e5aafd tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:33:37.188956 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-174f0f13-6b06-415a-b956-554026e5aafd tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:33:37.189384 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-174f0f13-6b06-415a-b956-554026e5aafd tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:33:37.321685 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-174f0f13-6b06-415a-b956-554026e5aafd tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cba9a710d9f4faeb9a267f284223dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d961f71194831954c10d99bcd4e64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:33:37.329724 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-174f0f13-6b06-415a-b956-554026e5aafd tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] 10.222.0.58 "GET /compute/v2.1/servers/7462d2ff-e093-4bfd-b223-def749c8175e" status: 200 len: 1318 microversion: 2.1 time: 0.153406 Mar 31 18:33:37.330282 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 569/1126] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:33:37 2022] GET /compute/v2.1/servers/7462d2ff-e093-4bfd-b223-def749c8175e => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:33:38.347610 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-af905dad-a5d8-4efd-87eb-bbd00e37cd9a tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:33:38.348135 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-af905dad-a5d8-4efd-87eb-bbd00e37cd9a tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] [instance: 7462d2ff-e093-4bfd-b223-def749c8175e] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:33:38.354470 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-af905dad-a5d8-4efd-87eb-bbd00e37cd9a tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:33:38.354944 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-af905dad-a5d8-4efd-87eb-bbd00e37cd9a tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:33:38.355764 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-af905dad-a5d8-4efd-87eb-bbd00e37cd9a tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:33:38.356198 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-af905dad-a5d8-4efd-87eb-bbd00e37cd9a tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:33:38.493407 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-af905dad-a5d8-4efd-87eb-bbd00e37cd9a tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cba9a710d9f4faeb9a267f284223dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d961f71194831954c10d99bcd4e64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:33:38.501853 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-af905dad-a5d8-4efd-87eb-bbd00e37cd9a tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] 10.222.0.58 "GET /compute/v2.1/servers/7462d2ff-e093-4bfd-b223-def749c8175e" status: 200 len: 1318 microversion: 2.1 time: 0.159141 Mar 31 18:33:38.502403 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 558/1127] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:33:38 2022] GET /compute/v2.1/servers/7462d2ff-e093-4bfd-b223-def749c8175e => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:33:39.518453 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-38915826-332a-4a6a-bf97-e7953831696a tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:33:39.519110 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-38915826-332a-4a6a-bf97-e7953831696a tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] [instance: 7462d2ff-e093-4bfd-b223-def749c8175e] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:33:39.525523 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-38915826-332a-4a6a-bf97-e7953831696a tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:33:39.525963 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-38915826-332a-4a6a-bf97-e7953831696a tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:33:39.526760 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-38915826-332a-4a6a-bf97-e7953831696a tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:33:39.527194 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-38915826-332a-4a6a-bf97-e7953831696a tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:33:39.659180 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-38915826-332a-4a6a-bf97-e7953831696a tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cba9a710d9f4faeb9a267f284223dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d961f71194831954c10d99bcd4e64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:33:39.666277 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-38915826-332a-4a6a-bf97-e7953831696a tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] 10.222.0.58 "GET /compute/v2.1/servers/7462d2ff-e093-4bfd-b223-def749c8175e" status: 200 len: 1318 microversion: 2.1 time: 0.151790 Mar 31 18:33:39.666870 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 570/1128] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:33:39 2022] GET /compute/v2.1/servers/7462d2ff-e093-4bfd-b223-def749c8175e => generated 1318 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:33:40.683914 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-0f443c22-7ef2-430a-85b6-a66f9f725649 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:33:40.684547 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-0f443c22-7ef2-430a-85b6-a66f9f725649 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] [instance: 7462d2ff-e093-4bfd-b223-def749c8175e] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:33:40.691528 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0f443c22-7ef2-430a-85b6-a66f9f725649 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:33:40.691903 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0f443c22-7ef2-430a-85b6-a66f9f725649 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:33:40.692652 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0f443c22-7ef2-430a-85b6-a66f9f725649 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:33:40.693075 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0f443c22-7ef2-430a-85b6-a66f9f725649 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:33:40.834158 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-0f443c22-7ef2-430a-85b6-a66f9f725649 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cba9a710d9f4faeb9a267f284223dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d961f71194831954c10d99bcd4e64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:33:40.841332 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-0f443c22-7ef2-430a-85b6-a66f9f725649 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] 10.222.0.58 "GET /compute/v2.1/servers/7462d2ff-e093-4bfd-b223-def749c8175e" status: 200 len: 1318 microversion: 2.1 time: 0.161464 Mar 31 18:33:40.841888 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 559/1129] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:33:40 2022] GET /compute/v2.1/servers/7462d2ff-e093-4bfd-b223-def749c8175e => generated 1318 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:33:41.857741 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-d0681e53-e723-4075-8f62-608bd89a063d tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:33:41.858430 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-d0681e53-e723-4075-8f62-608bd89a063d tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] [instance: 7462d2ff-e093-4bfd-b223-def749c8175e] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:33:41.866032 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-d0681e53-e723-4075-8f62-608bd89a063d tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:33:41.866486 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-d0681e53-e723-4075-8f62-608bd89a063d tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:33:41.867280 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-d0681e53-e723-4075-8f62-608bd89a063d tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:33:41.867713 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-d0681e53-e723-4075-8f62-608bd89a063d tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:33:42.009043 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-d0681e53-e723-4075-8f62-608bd89a063d tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cba9a710d9f4faeb9a267f284223dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d961f71194831954c10d99bcd4e64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:33:42.017047 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-d0681e53-e723-4075-8f62-608bd89a063d tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] 10.222.0.58 "GET /compute/v2.1/servers/7462d2ff-e093-4bfd-b223-def749c8175e" status: 200 len: 1318 microversion: 2.1 time: 0.163167 Mar 31 18:33:42.017619 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 571/1130] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:33:41 2022] GET /compute/v2.1/servers/7462d2ff-e093-4bfd-b223-def749c8175e => generated 1318 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:33:42.031427 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [req-43507c94-0aa2-42cb-b618-5089c940695e req-a7842e34-5953-426e-8ca8-74683b32566d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7462d2ff-e093-4bfd-b223-def749c8175e", "name": "network-vif-plugged", "status": "completed", "tag": "3f245005-1be9-4c70-b9bc-8dc2f82d8a7f"}]} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:33:42.040669 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-43507c94-0aa2-42cb-b618-5089c940695e req-a7842e34-5953-426e-8ca8-74683b32566d service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:33:42.043653 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-43507c94-0aa2-42cb-b618-5089c940695e req-a7842e34-5953-426e-8ca8-74683b32566d service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:33:42.052883 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.compute.server_external_events [req-43507c94-0aa2-42cb-b618-5089c940695e req-a7842e34-5953-426e-8ca8-74683b32566d service nova] Creating event network-vif-plugged:3f245005-1be9-4c70-b9bc-8dc2f82d8a7f for instance 7462d2ff-e093-4bfd-b223-def749c8175e on hv-cinder-maste Mar 31 18:33:42.058206 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [req-43507c94-0aa2-42cb-b618-5089c940695e req-a7842e34-5953-426e-8ca8-74683b32566d service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031534 Mar 31 18:33:42.058977 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 560/1131] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:33:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Mar 31 18:33:43.033376 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-cebf97b1-6253-411c-be8b-867e5b7bcf1b tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:33:43.034015 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-cebf97b1-6253-411c-be8b-867e5b7bcf1b tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] [instance: 7462d2ff-e093-4bfd-b223-def749c8175e] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:33:43.040312 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-cebf97b1-6253-411c-be8b-867e5b7bcf1b tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:33:43.040756 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-cebf97b1-6253-411c-be8b-867e5b7bcf1b tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:33:43.041519 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-cebf97b1-6253-411c-be8b-867e5b7bcf1b tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:33:43.041953 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-cebf97b1-6253-411c-be8b-867e5b7bcf1b tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:33:43.183022 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-cebf97b1-6253-411c-be8b-867e5b7bcf1b tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cba9a710d9f4faeb9a267f284223dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d961f71194831954c10d99bcd4e64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:33:43.190643 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-cebf97b1-6253-411c-be8b-867e5b7bcf1b tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] 10.222.0.58 "GET /compute/v2.1/servers/7462d2ff-e093-4bfd-b223-def749c8175e" status: 200 len: 1318 microversion: 2.1 time: 0.161192 Mar 31 18:33:43.191245 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 572/1132] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:33:43 2022] GET /compute/v2.1/servers/7462d2ff-e093-4bfd-b223-def749c8175e => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:33:43.995175 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 31 18:33:43.995765 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: Thu Mar 31 18:33:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 31 18:33:44.208355 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-fa621962-d17d-46d6-b785-b5f16b3c4b2d tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:33:44.209052 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-fa621962-d17d-46d6-b785-b5f16b3c4b2d tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] [instance: 7462d2ff-e093-4bfd-b223-def749c8175e] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:33:44.215865 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-fa621962-d17d-46d6-b785-b5f16b3c4b2d tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:33:44.216307 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-fa621962-d17d-46d6-b785-b5f16b3c4b2d tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:33:44.217063 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-fa621962-d17d-46d6-b785-b5f16b3c4b2d tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:33:44.217493 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-fa621962-d17d-46d6-b785-b5f16b3c4b2d tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:33:44.354382 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-fa621962-d17d-46d6-b785-b5f16b3c4b2d tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cba9a710d9f4faeb9a267f284223dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d961f71194831954c10d99bcd4e64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:33:44.362377 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-fa621962-d17d-46d6-b785-b5f16b3c4b2d tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] 10.222.0.58 "GET /compute/v2.1/servers/7462d2ff-e093-4bfd-b223-def749c8175e" status: 200 len: 1318 microversion: 2.1 time: 0.158369 Mar 31 18:33:44.363013 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 561/1133] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:33:44 2022] GET /compute/v2.1/servers/7462d2ff-e093-4bfd-b223-def749c8175e => generated 1318 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:33:45.379645 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-6a9e2d72-83dd-4bde-80e7-3b34cd0be5da tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:33:45.380222 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-6a9e2d72-83dd-4bde-80e7-3b34cd0be5da tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] [instance: 7462d2ff-e093-4bfd-b223-def749c8175e] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:33:45.386101 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6a9e2d72-83dd-4bde-80e7-3b34cd0be5da tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:33:45.386537 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6a9e2d72-83dd-4bde-80e7-3b34cd0be5da tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:33:45.387322 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6a9e2d72-83dd-4bde-80e7-3b34cd0be5da tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:33:45.387743 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6a9e2d72-83dd-4bde-80e7-3b34cd0be5da tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:33:45.519346 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-6a9e2d72-83dd-4bde-80e7-3b34cd0be5da tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cba9a710d9f4faeb9a267f284223dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d961f71194831954c10d99bcd4e64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:33:45.526770 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-6a9e2d72-83dd-4bde-80e7-3b34cd0be5da tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] 10.222.0.58 "GET /compute/v2.1/servers/7462d2ff-e093-4bfd-b223-def749c8175e" status: 200 len: 1508 microversion: 2.1 time: 0.150944 Mar 31 18:33:45.527333 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 573/1134] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:33:45 2022] GET /compute/v2.1/servers/7462d2ff-e093-4bfd-b223-def749c8175e => generated 1508 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:33:51.936428 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 31 18:33:51.937146 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: Thu Mar 31 18:33:51 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 31 18:34:10.509948 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-ea833c6c-1ccb-4d8e-92bc-0ccdb88a24f7 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "07f32d3a-f74e-41ad-916f-2f9fc98e73ac", "device": "/dev/sdb"}} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:34:10.511557 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-ea833c6c-1ccb-4d8e-92bc-0ccdb88a24f7 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] [instance: 7462d2ff-e093-4bfd-b223-def749c8175e] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:34:10.518181 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ea833c6c-1ccb-4d8e-92bc-0ccdb88a24f7 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:34:10.519413 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ea833c6c-1ccb-4d8e-92bc-0ccdb88a24f7 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:34:10.520271 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ea833c6c-1ccb-4d8e-92bc-0ccdb88a24f7 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:34:10.520780 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-ea833c6c-1ccb-4d8e-92bc-0ccdb88a24f7 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:34:11.428994 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-ea833c6c-1ccb-4d8e-92bc-0ccdb88a24f7 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] 10.222.0.58 "POST /compute/v2.1/servers/7462d2ff-e093-4bfd-b223-def749c8175e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.923045 Mar 31 18:34:11.429618 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 562/1135] 10.222.0.58 () {60 vars in 1322 bytes} [Thu Mar 31 18:34:10 2022] POST /compute/v2.1/servers/7462d2ff-e093-4bfd-b223-def749c8175e/os-volume_attachments => generated 194 bytes in 925 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:34:40.232856 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-c1dcd5a7-8841-4fd2-985d-c4be98db6106 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:34:40.233379 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-c1dcd5a7-8841-4fd2-985d-c4be98db6106 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] [instance: 7462d2ff-e093-4bfd-b223-def749c8175e] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:34:40.239677 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c1dcd5a7-8841-4fd2-985d-c4be98db6106 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:34:40.240120 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c1dcd5a7-8841-4fd2-985d-c4be98db6106 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:34:40.240867 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c1dcd5a7-8841-4fd2-985d-c4be98db6106 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:34:40.241292 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c1dcd5a7-8841-4fd2-985d-c4be98db6106 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:34:40.372347 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.objects.instance [None req-c1dcd5a7-8841-4fd2-985d-c4be98db6106 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lazy-loading 'services' on Instance uuid 7462d2ff-e093-4bfd-b223-def749c8175e {{(pid=117538) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 31 18:34:40.630160 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-c1dcd5a7-8841-4fd2-985d-c4be98db6106 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7462d2ff-e093-4bfd-b223-def749c8175e/os-volume_attachments/07f32d3a-f74e-41ad-916f-2f9fc98e73ac" status: 202 len: 0 microversion: 2.1 time: 0.400933 Mar 31 18:34:40.631016 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 574/1136] 10.222.0.58 () {58 vars in 1415 bytes} [Thu Mar 31 18:34:40 2022] DELETE /compute/v2.1/servers/7462d2ff-e093-4bfd-b223-def749c8175e/os-volume_attachments/07f32d3a-f74e-41ad-916f-2f9fc98e73ac => generated 0 bytes in 403 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 31 18:34:41.743447 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-56daa36e-c21c-47de-a9a9-a3bea7f570c5 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:34:41.744013 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-56daa36e-c21c-47de-a9a9-a3bea7f570c5 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] [instance: 7462d2ff-e093-4bfd-b223-def749c8175e] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:34:41.750082 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-56daa36e-c21c-47de-a9a9-a3bea7f570c5 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:34:41.750527 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-56daa36e-c21c-47de-a9a9-a3bea7f570c5 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:34:41.751323 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-56daa36e-c21c-47de-a9a9-a3bea7f570c5 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:34:41.751752 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-56daa36e-c21c-47de-a9a9-a3bea7f570c5 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:34:41.776856 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-56daa36e-c21c-47de-a9a9-a3bea7f570c5 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] [instance: 7462d2ff-e093-4bfd-b223-def749c8175e] Going to try to terminate instance {{(pid=117539) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 31 18:34:42.116944 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-56daa36e-c21c-47de-a9a9-a3bea7f570c5 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] 10.222.0.58 "DELETE /compute/v2.1/servers/7462d2ff-e093-4bfd-b223-def749c8175e" status: 204 len: 0 microversion: 2.1 time: 0.378817 Mar 31 18:34:42.117565 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 563/1137] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Mar 31 18:34:41 2022] DELETE /compute/v2.1/servers/7462d2ff-e093-4bfd-b223-def749c8175e => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 31 18:34:42.126800 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-02ab4f95-7f30-4457-8815-ff992860fa56 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:34:42.127495 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-02ab4f95-7f30-4457-8815-ff992860fa56 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] [instance: 7462d2ff-e093-4bfd-b223-def749c8175e] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:34:42.133666 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-02ab4f95-7f30-4457-8815-ff992860fa56 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:34:42.134866 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-02ab4f95-7f30-4457-8815-ff992860fa56 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:34:42.135007 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-02ab4f95-7f30-4457-8815-ff992860fa56 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:34:42.135368 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-02ab4f95-7f30-4457-8815-ff992860fa56 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:34:42.269058 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-02ab4f95-7f30-4457-8815-ff992860fa56 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cba9a710d9f4faeb9a267f284223dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d961f71194831954c10d99bcd4e64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:34:42.277545 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-02ab4f95-7f30-4457-8815-ff992860fa56 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] 10.222.0.58 "GET /compute/v2.1/servers/7462d2ff-e093-4bfd-b223-def749c8175e" status: 200 len: 1514 microversion: 2.1 time: 0.155467 Mar 31 18:34:42.278141 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 575/1138] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:34:42 2022] GET /compute/v2.1/servers/7462d2ff-e093-4bfd-b223-def749c8175e => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:34:43.296297 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-e0b0fd62-62d0-47ac-b08f-80f8707c8885 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:34:43.297064 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-e0b0fd62-62d0-47ac-b08f-80f8707c8885 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] [instance: 7462d2ff-e093-4bfd-b223-def749c8175e] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:34:43.304043 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e0b0fd62-62d0-47ac-b08f-80f8707c8885 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:34:43.304486 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e0b0fd62-62d0-47ac-b08f-80f8707c8885 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:34:43.305250 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e0b0fd62-62d0-47ac-b08f-80f8707c8885 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:34:43.305685 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e0b0fd62-62d0-47ac-b08f-80f8707c8885 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:34:43.439306 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-e0b0fd62-62d0-47ac-b08f-80f8707c8885 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cba9a710d9f4faeb9a267f284223dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d961f71194831954c10d99bcd4e64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:34:43.446956 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-e0b0fd62-62d0-47ac-b08f-80f8707c8885 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] 10.222.0.58 "GET /compute/v2.1/servers/7462d2ff-e093-4bfd-b223-def749c8175e" status: 200 len: 1514 microversion: 2.1 time: 0.154902 Mar 31 18:34:43.447515 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 564/1139] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:34:43 2022] GET /compute/v2.1/servers/7462d2ff-e093-4bfd-b223-def749c8175e => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:34:44.464601 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-80b24308-6d85-4c86-a8e2-ee8591ca7aed tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:34:44.465184 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-80b24308-6d85-4c86-a8e2-ee8591ca7aed tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] [instance: 7462d2ff-e093-4bfd-b223-def749c8175e] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:34:44.471653 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-80b24308-6d85-4c86-a8e2-ee8591ca7aed tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:34:44.472096 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-80b24308-6d85-4c86-a8e2-ee8591ca7aed tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:34:44.472852 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-80b24308-6d85-4c86-a8e2-ee8591ca7aed tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:34:44.473465 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-80b24308-6d85-4c86-a8e2-ee8591ca7aed tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:34:44.657328 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-80b24308-6d85-4c86-a8e2-ee8591ca7aed tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cba9a710d9f4faeb9a267f284223dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d961f71194831954c10d99bcd4e64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:34:44.665466 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-80b24308-6d85-4c86-a8e2-ee8591ca7aed tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] 10.222.0.58 "GET /compute/v2.1/servers/7462d2ff-e093-4bfd-b223-def749c8175e" status: 200 len: 1514 microversion: 2.1 time: 0.204788 Mar 31 18:34:44.666033 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 576/1140] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:34:44 2022] GET /compute/v2.1/servers/7462d2ff-e093-4bfd-b223-def749c8175e => generated 1514 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:34:44.806558 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [req-e4d21768-529c-4ce4-b94d-019bbea747b2 req-6ac58a58-8442-412e-8e0e-864594e7cd3f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7462d2ff-e093-4bfd-b223-def749c8175e", "name": "network-vif-deleted", "tag": "3f245005-1be9-4c70-b9bc-8dc2f82d8a7f"}]} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:34:44.815409 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-e4d21768-529c-4ce4-b94d-019bbea747b2 req-6ac58a58-8442-412e-8e0e-864594e7cd3f service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:34:44.817135 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-e4d21768-529c-4ce4-b94d-019bbea747b2 req-6ac58a58-8442-412e-8e0e-864594e7cd3f service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:34:44.828068 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.compute.server_external_events [req-e4d21768-529c-4ce4-b94d-019bbea747b2 req-6ac58a58-8442-412e-8e0e-864594e7cd3f service nova] Creating event network-vif-deleted:3f245005-1be9-4c70-b9bc-8dc2f82d8a7f for instance 7462d2ff-e093-4bfd-b223-def749c8175e on hv-cinder-maste Mar 31 18:34:44.833084 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [req-e4d21768-529c-4ce4-b94d-019bbea747b2 req-6ac58a58-8442-412e-8e0e-864594e7cd3f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030412 Mar 31 18:34:44.834803 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 565/1141] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:34:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:34:45.683049 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-4f30e360-c680-43cb-ad87-e2a5261afbf6 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:34:45.683709 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-4f30e360-c680-43cb-ad87-e2a5261afbf6 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] [instance: 7462d2ff-e093-4bfd-b223-def749c8175e] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:34:45.689592 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4f30e360-c680-43cb-ad87-e2a5261afbf6 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:34:45.690047 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4f30e360-c680-43cb-ad87-e2a5261afbf6 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:34:45.690884 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4f30e360-c680-43cb-ad87-e2a5261afbf6 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:34:45.691318 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4f30e360-c680-43cb-ad87-e2a5261afbf6 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:34:45.721293 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4f30e360-c680-43cb-ad87-e2a5261afbf6 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:34:45.721738 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4f30e360-c680-43cb-ad87-e2a5261afbf6 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:34:45.722188 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.objects.instance [None req-4f30e360-c680-43cb-ad87-e2a5261afbf6 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lazy-loading 'fault' on Instance uuid 7462d2ff-e093-4bfd-b223-def749c8175e {{(pid=117538) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 31 18:34:45.765905 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-4f30e360-c680-43cb-ad87-e2a5261afbf6 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cba9a710d9f4faeb9a267f284223dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d961f71194831954c10d99bcd4e64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:34:45.774184 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-4f30e360-c680-43cb-ad87-e2a5261afbf6 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] 10.222.0.58 "GET /compute/v2.1/servers/7462d2ff-e093-4bfd-b223-def749c8175e" status: 200 len: 1308 microversion: 2.1 time: 0.095864 Mar 31 18:34:45.774782 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 577/1142] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:34:45 2022] GET /compute/v2.1/servers/7462d2ff-e093-4bfd-b223-def749c8175e => generated 1308 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:34:46.793020 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-7103f15d-bc2a-44f5-b254-52622a73d820 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:34:46.793704 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-7103f15d-bc2a-44f5-b254-52622a73d820 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] [instance: 7462d2ff-e093-4bfd-b223-def749c8175e] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:34:46.799791 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-7103f15d-bc2a-44f5-b254-52622a73d820 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:34:46.800231 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-7103f15d-bc2a-44f5-b254-52622a73d820 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:34:46.801132 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-7103f15d-bc2a-44f5-b254-52622a73d820 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:34:46.801561 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-7103f15d-bc2a-44f5-b254-52622a73d820 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:34:46.816396 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.wsgi [None req-7103f15d-bc2a-44f5-b254-52622a73d820 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] HTTP exception thrown: Instance 7462d2ff-e093-4bfd-b223-def749c8175e could not be found. Mar 31 18:34:46.816967 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-7103f15d-bc2a-44f5-b254-52622a73d820 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Returning 404 to user: Instance 7462d2ff-e093-4bfd-b223-def749c8175e could not be found. {{(pid=117539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:34:46.817763 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-7103f15d-bc2a-44f5-b254-52622a73d820 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] 10.222.0.58 "GET /compute/v2.1/servers/7462d2ff-e093-4bfd-b223-def749c8175e" status: 404 len: 111 microversion: 2.1 time: 0.029480 Mar 31 18:34:46.818489 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 566/1143] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:34:46 2022] GET /compute/v2.1/servers/7462d2ff-e093-4bfd-b223-def749c8175e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 31 18:34:57.305661 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-85604d55-ba28-454a-854e-183cd3e92fdf tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1704671482", "imageRef": "6241b999-6f6d-4076-88bc-345fa7386256", "flavorRef": "452", "networks": [{"uuid": "197de12b-9d63-43d4-82b6-c8da9ef22625"}]}} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:34:57.357556 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.network.neutron [None req-85604d55-ba28-454a-854e-183cd3e92fdf tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] validate_networks() for [('197de12b-9d63-43d4-82b6-c8da9ef22625', None, None, None, None, None)] {{(pid=117538) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 31 18:34:57.697862 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.virt.hardware [None req-85604d55-ba28-454a-854e-183cd3e92fdf tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Flavor limits 0:0:0 {{(pid=117538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 31 18:34:57.698323 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.virt.hardware [None req-85604d55-ba28-454a-854e-183cd3e92fdf tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Image limits 0:0:0 {{(pid=117538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 31 18:34:57.698831 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.virt.hardware [None req-85604d55-ba28-454a-854e-183cd3e92fdf tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Flavor pref 0:0:0 {{(pid=117538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 31 18:34:57.699237 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.virt.hardware [None req-85604d55-ba28-454a-854e-183cd3e92fdf tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Image pref 0:0:0 {{(pid=117538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 31 18:34:57.699645 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.virt.hardware [None req-85604d55-ba28-454a-854e-183cd3e92fdf tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 31 18:34:57.708538 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-85604d55-ba28-454a-854e-183cd3e92fdf tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:34:57.708979 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-85604d55-ba28-454a-854e-183cd3e92fdf tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:34:57.710272 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-85604d55-ba28-454a-854e-183cd3e92fdf tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:34:57.710727 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-85604d55-ba28-454a-854e-183cd3e92fdf tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:34:57.727113 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.quota [None req-85604d55-ba28-454a-854e-183cd3e92fdf tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Getting quotas for project 0f2d961f71194831954c10d99bcd4e64. Resources: {'instances', 'ram', 'cores'} {{(pid=117538) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 31 18:34:57.730922 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.quota [None req-85604d55-ba28-454a-854e-183cd3e92fdf tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Getting quotas for user 1cba9a710d9f4faeb9a267f284223dc0 and project 0f2d961f71194831954c10d99bcd4e64. Resources: {'instances', 'ram', 'cores'} {{(pid=117538) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 31 18:34:57.741330 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-85604d55-ba28-454a-854e-183cd3e92fdf tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Going to run 1 instances... {{(pid=117538) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 31 18:34:57.743593 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-85604d55-ba28-454a-854e-183cd3e92fdf tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] [instance: 40e6139b-cfed-4448-b816-1142e9f6f6d5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='6241b999-6f6d-4076-88bc-345fa7386256',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117538) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 31 18:34:57.883124 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-85604d55-ba28-454a-854e-183cd3e92fdf tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.582176 Mar 31 18:34:57.883672 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 578/1144] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Mar 31 18:34:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 584 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Mar 31 18:34:57.893543 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-d7c32387-2af5-4c5a-92ff-3d80a49328b8 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:34:57.894295 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-d7c32387-2af5-4c5a-92ff-3d80a49328b8 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] [instance: 40e6139b-cfed-4448-b816-1142e9f6f6d5] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:34:57.951806 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-d7c32387-2af5-4c5a-92ff-3d80a49328b8 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cba9a710d9f4faeb9a267f284223dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d961f71194831954c10d99bcd4e64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:34:57.958465 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-d7c32387-2af5-4c5a-92ff-3d80a49328b8 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] 10.222.0.58 "GET /compute/v2.1/servers/40e6139b-cfed-4448-b816-1142e9f6f6d5" status: 200 len: 1219 microversion: 2.1 time: 0.068711 Mar 31 18:34:57.959139 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 567/1145] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:34:57 2022] GET /compute/v2.1/servers/40e6139b-cfed-4448-b816-1142e9f6f6d5 => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:34:58.977613 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-fc935e7f-0dca-4b3c-bfc0-0acc970b6658 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:34:58.978257 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-fc935e7f-0dca-4b3c-bfc0-0acc970b6658 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] [instance: 40e6139b-cfed-4448-b816-1142e9f6f6d5] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:34:58.984319 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-fc935e7f-0dca-4b3c-bfc0-0acc970b6658 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:34:58.984761 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-fc935e7f-0dca-4b3c-bfc0-0acc970b6658 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:34:58.985523 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-fc935e7f-0dca-4b3c-bfc0-0acc970b6658 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:34:58.985983 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-fc935e7f-0dca-4b3c-bfc0-0acc970b6658 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:34:59.051678 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-fc935e7f-0dca-4b3c-bfc0-0acc970b6658 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cba9a710d9f4faeb9a267f284223dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d961f71194831954c10d99bcd4e64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:34:59.062770 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-fc935e7f-0dca-4b3c-bfc0-0acc970b6658 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] 10.222.0.58 "GET /compute/v2.1/servers/40e6139b-cfed-4448-b816-1142e9f6f6d5" status: 200 len: 1223 microversion: 2.1 time: 0.089933 Mar 31 18:34:59.063359 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 579/1146] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:34:58 2022] GET /compute/v2.1/servers/40e6139b-cfed-4448-b816-1142e9f6f6d5 => generated 1223 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:35:00.080216 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-c628401b-c52a-4521-8a4f-2e793d1b8225 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:35:00.080826 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-c628401b-c52a-4521-8a4f-2e793d1b8225 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] [instance: 40e6139b-cfed-4448-b816-1142e9f6f6d5] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:35:00.087895 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c628401b-c52a-4521-8a4f-2e793d1b8225 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:35:00.088340 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c628401b-c52a-4521-8a4f-2e793d1b8225 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:35:00.089107 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c628401b-c52a-4521-8a4f-2e793d1b8225 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:35:00.089541 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c628401b-c52a-4521-8a4f-2e793d1b8225 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:35:00.151955 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-c628401b-c52a-4521-8a4f-2e793d1b8225 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cba9a710d9f4faeb9a267f284223dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d961f71194831954c10d99bcd4e64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:35:00.159423 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-c628401b-c52a-4521-8a4f-2e793d1b8225 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] 10.222.0.58 "GET /compute/v2.1/servers/40e6139b-cfed-4448-b816-1142e9f6f6d5" status: 200 len: 1279 microversion: 2.1 time: 0.083012 Mar 31 18:35:00.170232 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 568/1147] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:35:00 2022] GET /compute/v2.1/servers/40e6139b-cfed-4448-b816-1142e9f6f6d5 => generated 1279 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:35:01.176798 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-b49d9002-7920-4cb7-b742-1578a98913ec tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:35:01.177395 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-b49d9002-7920-4cb7-b742-1578a98913ec tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] [instance: 40e6139b-cfed-4448-b816-1142e9f6f6d5] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:35:01.184535 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b49d9002-7920-4cb7-b742-1578a98913ec tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:35:01.185013 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b49d9002-7920-4cb7-b742-1578a98913ec tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:35:01.185850 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b49d9002-7920-4cb7-b742-1578a98913ec tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:35:01.186320 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-b49d9002-7920-4cb7-b742-1578a98913ec tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:35:01.416067 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-b49d9002-7920-4cb7-b742-1578a98913ec tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cba9a710d9f4faeb9a267f284223dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d961f71194831954c10d99bcd4e64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:35:01.426354 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-b49d9002-7920-4cb7-b742-1578a98913ec tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] 10.222.0.58 "GET /compute/v2.1/servers/40e6139b-cfed-4448-b816-1142e9f6f6d5" status: 200 len: 1319 microversion: 2.1 time: 0.253242 Mar 31 18:35:01.427252 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 580/1148] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:35:01 2022] GET /compute/v2.1/servers/40e6139b-cfed-4448-b816-1142e9f6f6d5 => generated 1319 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:35:01.806321 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [req-82f4a798-dfe9-47c3-83d2-46d3995ae44b req-01f6b097-f2e2-49dd-b362-0948a8d9702f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40e6139b-cfed-4448-b816-1142e9f6f6d5", "tag": "5cc3bd2c-980d-4f01-a647-0aaa037bd9ae"}]} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:35:01.815548 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-82f4a798-dfe9-47c3-83d2-46d3995ae44b req-01f6b097-f2e2-49dd-b362-0948a8d9702f service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:35:01.816423 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-82f4a798-dfe9-47c3-83d2-46d3995ae44b req-01f6b097-f2e2-49dd-b362-0948a8d9702f service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:35:01.833354 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.compute.server_external_events [req-82f4a798-dfe9-47c3-83d2-46d3995ae44b req-01f6b097-f2e2-49dd-b362-0948a8d9702f service nova] Creating event network-changed:5cc3bd2c-980d-4f01-a647-0aaa037bd9ae for instance 40e6139b-cfed-4448-b816-1142e9f6f6d5 on hv-cinder-maste Mar 31 18:35:01.838942 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [req-82f4a798-dfe9-47c3-83d2-46d3995ae44b req-01f6b097-f2e2-49dd-b362-0948a8d9702f service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037842 Mar 31 18:35:01.839618 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 569/1149] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:35:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:35:02.450148 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-dd0e1b29-3045-4a58-aadb-6771a27efe46 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:35:02.450821 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-dd0e1b29-3045-4a58-aadb-6771a27efe46 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] [instance: 40e6139b-cfed-4448-b816-1142e9f6f6d5] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:35:02.457180 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-dd0e1b29-3045-4a58-aadb-6771a27efe46 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:35:02.457625 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-dd0e1b29-3045-4a58-aadb-6771a27efe46 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:35:02.458442 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-dd0e1b29-3045-4a58-aadb-6771a27efe46 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:35:02.458840 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-dd0e1b29-3045-4a58-aadb-6771a27efe46 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:35:02.677396 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-dd0e1b29-3045-4a58-aadb-6771a27efe46 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cba9a710d9f4faeb9a267f284223dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d961f71194831954c10d99bcd4e64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:35:02.685964 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-dd0e1b29-3045-4a58-aadb-6771a27efe46 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] 10.222.0.58 "GET /compute/v2.1/servers/40e6139b-cfed-4448-b816-1142e9f6f6d5" status: 200 len: 1319 microversion: 2.1 time: 0.239463 Mar 31 18:35:02.686542 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 581/1150] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:35:02 2022] GET /compute/v2.1/servers/40e6139b-cfed-4448-b816-1142e9f6f6d5 => generated 1319 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:35:03.707904 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-80d3ccef-ef2c-4eeb-94eb-313748d50923 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:35:03.708595 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-80d3ccef-ef2c-4eeb-94eb-313748d50923 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] [instance: 40e6139b-cfed-4448-b816-1142e9f6f6d5] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:35:03.715805 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-80d3ccef-ef2c-4eeb-94eb-313748d50923 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:35:03.716247 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-80d3ccef-ef2c-4eeb-94eb-313748d50923 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:35:03.717231 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-80d3ccef-ef2c-4eeb-94eb-313748d50923 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:35:03.717667 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-80d3ccef-ef2c-4eeb-94eb-313748d50923 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:35:03.857805 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-80d3ccef-ef2c-4eeb-94eb-313748d50923 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cba9a710d9f4faeb9a267f284223dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d961f71194831954c10d99bcd4e64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:35:03.865652 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-80d3ccef-ef2c-4eeb-94eb-313748d50923 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] 10.222.0.58 "GET /compute/v2.1/servers/40e6139b-cfed-4448-b816-1142e9f6f6d5" status: 200 len: 1319 microversion: 2.1 time: 0.162500 Mar 31 18:35:03.866721 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 570/1151] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:35:03 2022] GET /compute/v2.1/servers/40e6139b-cfed-4448-b816-1142e9f6f6d5 => generated 1319 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:35:04.883619 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-1248398a-30f1-45a0-9b16-62f6e3a39ed0 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:35:04.884287 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-1248398a-30f1-45a0-9b16-62f6e3a39ed0 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] [instance: 40e6139b-cfed-4448-b816-1142e9f6f6d5] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:35:04.890742 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-1248398a-30f1-45a0-9b16-62f6e3a39ed0 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:35:04.891179 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-1248398a-30f1-45a0-9b16-62f6e3a39ed0 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:35:04.891936 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-1248398a-30f1-45a0-9b16-62f6e3a39ed0 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:35:04.892359 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-1248398a-30f1-45a0-9b16-62f6e3a39ed0 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:35:05.047812 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-1248398a-30f1-45a0-9b16-62f6e3a39ed0 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cba9a710d9f4faeb9a267f284223dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d961f71194831954c10d99bcd4e64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:35:05.053662 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-1248398a-30f1-45a0-9b16-62f6e3a39ed0 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] 10.222.0.58 "GET /compute/v2.1/servers/40e6139b-cfed-4448-b816-1142e9f6f6d5" status: 200 len: 1319 microversion: 2.1 time: 0.173819 Mar 31 18:35:05.054798 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 582/1152] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:35:04 2022] GET /compute/v2.1/servers/40e6139b-cfed-4448-b816-1142e9f6f6d5 => generated 1319 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:35:06.072147 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-4c2e99f9-9fff-4eb4-9964-1b6fb155ce68 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:35:06.072755 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-4c2e99f9-9fff-4eb4-9964-1b6fb155ce68 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] [instance: 40e6139b-cfed-4448-b816-1142e9f6f6d5] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:35:06.079178 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-4c2e99f9-9fff-4eb4-9964-1b6fb155ce68 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:35:06.079669 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-4c2e99f9-9fff-4eb4-9964-1b6fb155ce68 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:35:06.080471 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-4c2e99f9-9fff-4eb4-9964-1b6fb155ce68 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:35:06.080938 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-4c2e99f9-9fff-4eb4-9964-1b6fb155ce68 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:35:06.220791 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-4c2e99f9-9fff-4eb4-9964-1b6fb155ce68 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cba9a710d9f4faeb9a267f284223dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d961f71194831954c10d99bcd4e64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:35:06.229065 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-4c2e99f9-9fff-4eb4-9964-1b6fb155ce68 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] 10.222.0.58 "GET /compute/v2.1/servers/40e6139b-cfed-4448-b816-1142e9f6f6d5" status: 200 len: 1319 microversion: 2.1 time: 0.161983 Mar 31 18:35:06.229629 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 571/1153] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:35:06 2022] GET /compute/v2.1/servers/40e6139b-cfed-4448-b816-1142e9f6f6d5 => generated 1319 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:35:07.029945 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [req-8e512da3-a02d-4333-b314-c975ec6adbd1 req-a85f2b34-31b0-4bfb-9dc0-75e6dd3463ff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40e6139b-cfed-4448-b816-1142e9f6f6d5", "name": "network-vif-plugged", "status": "completed", "tag": "5cc3bd2c-980d-4f01-a647-0aaa037bd9ae"}]} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:35:07.040476 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-8e512da3-a02d-4333-b314-c975ec6adbd1 req-a85f2b34-31b0-4bfb-9dc0-75e6dd3463ff service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:35:07.040476 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-8e512da3-a02d-4333-b314-c975ec6adbd1 req-a85f2b34-31b0-4bfb-9dc0-75e6dd3463ff service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:35:07.055720 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.compute.server_external_events [req-8e512da3-a02d-4333-b314-c975ec6adbd1 req-a85f2b34-31b0-4bfb-9dc0-75e6dd3463ff service nova] Creating event network-vif-plugged:5cc3bd2c-980d-4f01-a647-0aaa037bd9ae for instance 40e6139b-cfed-4448-b816-1142e9f6f6d5 on hv-cinder-maste Mar 31 18:35:07.058685 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [req-8e512da3-a02d-4333-b314-c975ec6adbd1 req-a85f2b34-31b0-4bfb-9dc0-75e6dd3463ff service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032323 Mar 31 18:35:07.059292 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 583/1154] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:35:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:35:07.246684 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-677d2d47-9491-4c89-9e7b-57dc5e067b0b tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:35:07.247362 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-677d2d47-9491-4c89-9e7b-57dc5e067b0b tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] [instance: 40e6139b-cfed-4448-b816-1142e9f6f6d5] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:35:07.253725 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-677d2d47-9491-4c89-9e7b-57dc5e067b0b tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:35:07.254181 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-677d2d47-9491-4c89-9e7b-57dc5e067b0b tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:35:07.254946 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-677d2d47-9491-4c89-9e7b-57dc5e067b0b tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:35:07.255371 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-677d2d47-9491-4c89-9e7b-57dc5e067b0b tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:35:07.394717 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-677d2d47-9491-4c89-9e7b-57dc5e067b0b tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cba9a710d9f4faeb9a267f284223dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d961f71194831954c10d99bcd4e64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:35:07.403008 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-677d2d47-9491-4c89-9e7b-57dc5e067b0b tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] 10.222.0.58 "GET /compute/v2.1/servers/40e6139b-cfed-4448-b816-1142e9f6f6d5" status: 200 len: 1319 microversion: 2.1 time: 0.160410 Mar 31 18:35:07.403570 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 572/1155] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:35:07 2022] GET /compute/v2.1/servers/40e6139b-cfed-4448-b816-1142e9f6f6d5 => generated 1319 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:35:08.421337 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-84bf0a50-22ae-4503-a3a3-74ba52584c47 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:35:08.421948 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-84bf0a50-22ae-4503-a3a3-74ba52584c47 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] [instance: 40e6139b-cfed-4448-b816-1142e9f6f6d5] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:35:08.429218 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-84bf0a50-22ae-4503-a3a3-74ba52584c47 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:35:08.429695 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-84bf0a50-22ae-4503-a3a3-74ba52584c47 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:35:08.430456 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-84bf0a50-22ae-4503-a3a3-74ba52584c47 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:35:08.430906 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-84bf0a50-22ae-4503-a3a3-74ba52584c47 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:35:08.568714 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-84bf0a50-22ae-4503-a3a3-74ba52584c47 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cba9a710d9f4faeb9a267f284223dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d961f71194831954c10d99bcd4e64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:35:08.576013 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-84bf0a50-22ae-4503-a3a3-74ba52584c47 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] 10.222.0.58 "GET /compute/v2.1/servers/40e6139b-cfed-4448-b816-1142e9f6f6d5" status: 200 len: 1319 microversion: 2.1 time: 0.159273 Mar 31 18:35:08.576570 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 584/1156] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:35:08 2022] GET /compute/v2.1/servers/40e6139b-cfed-4448-b816-1142e9f6f6d5 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:35:09.593375 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-2e786f5f-474f-4ad3-819e-00cbc31071c4 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:35:09.593974 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-2e786f5f-474f-4ad3-819e-00cbc31071c4 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] [instance: 40e6139b-cfed-4448-b816-1142e9f6f6d5] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:35:09.600763 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-2e786f5f-474f-4ad3-819e-00cbc31071c4 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:35:09.601207 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-2e786f5f-474f-4ad3-819e-00cbc31071c4 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:35:09.602005 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-2e786f5f-474f-4ad3-819e-00cbc31071c4 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:35:09.602986 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-2e786f5f-474f-4ad3-819e-00cbc31071c4 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:35:09.736569 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-2e786f5f-474f-4ad3-819e-00cbc31071c4 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cba9a710d9f4faeb9a267f284223dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d961f71194831954c10d99bcd4e64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:35:09.744313 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-2e786f5f-474f-4ad3-819e-00cbc31071c4 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] 10.222.0.58 "GET /compute/v2.1/servers/40e6139b-cfed-4448-b816-1142e9f6f6d5" status: 200 len: 1509 microversion: 2.1 time: 0.154915 Mar 31 18:35:09.744871 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 573/1157] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:35:09 2022] GET /compute/v2.1/servers/40e6139b-cfed-4448-b816-1142e9f6f6d5 => generated 1509 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:35:09.761295 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-7ea14e9c-47f2-48a8-ab16-a4967581fa38 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "152a59e7-3c1b-46e5-917c-32ea27b813c8", "device": "/dev/sdb"}} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:35:09.762885 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-7ea14e9c-47f2-48a8-ab16-a4967581fa38 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] [instance: 40e6139b-cfed-4448-b816-1142e9f6f6d5] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:35:09.769108 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-7ea14e9c-47f2-48a8-ab16-a4967581fa38 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:35:09.769559 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-7ea14e9c-47f2-48a8-ab16-a4967581fa38 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:35:09.770403 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-7ea14e9c-47f2-48a8-ab16-a4967581fa38 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:35:09.770786 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-7ea14e9c-47f2-48a8-ab16-a4967581fa38 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:35:10.899239 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-7ea14e9c-47f2-48a8-ab16-a4967581fa38 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] 10.222.0.58 "POST /compute/v2.1/servers/40e6139b-cfed-4448-b816-1142e9f6f6d5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.139066 Mar 31 18:35:10.899239 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 585/1158] 10.222.0.58 () {60 vars in 1322 bytes} [Thu Mar 31 18:35:09 2022] POST /compute/v2.1/servers/40e6139b-cfed-4448-b816-1142e9f6f6d5/os-volume_attachments => generated 194 bytes in 1141 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:35:34.007025 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-c202b5c5-9bdb-4059-94c1-f939cfd509c2 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:35:34.007817 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-c202b5c5-9bdb-4059-94c1-f939cfd509c2 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] [instance: 40e6139b-cfed-4448-b816-1142e9f6f6d5] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:35:34.013716 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c202b5c5-9bdb-4059-94c1-f939cfd509c2 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:35:34.014162 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c202b5c5-9bdb-4059-94c1-f939cfd509c2 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:35:34.014967 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c202b5c5-9bdb-4059-94c1-f939cfd509c2 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:35:34.015396 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c202b5c5-9bdb-4059-94c1-f939cfd509c2 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:35:34.100199 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.objects.instance [None req-c202b5c5-9bdb-4059-94c1-f939cfd509c2 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lazy-loading 'services' on Instance uuid 40e6139b-cfed-4448-b816-1142e9f6f6d5 {{(pid=117539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 31 18:35:34.313804 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-c202b5c5-9bdb-4059-94c1-f939cfd509c2 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] 10.222.0.58 "DELETE /compute/v2.1/servers/40e6139b-cfed-4448-b816-1142e9f6f6d5/os-volume_attachments/152a59e7-3c1b-46e5-917c-32ea27b813c8" status: 202 len: 0 microversion: 2.1 time: 0.310744 Mar 31 18:35:34.314448 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 574/1159] 10.222.0.58 () {58 vars in 1415 bytes} [Thu Mar 31 18:35:34 2022] DELETE /compute/v2.1/servers/40e6139b-cfed-4448-b816-1142e9f6f6d5/os-volume_attachments/152a59e7-3c1b-46e5-917c-32ea27b813c8 => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 31 18:35:36.481309 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-ffea2086-a455-49ee-81ea-83ee278a4f28 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:35:36.481888 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-ffea2086-a455-49ee-81ea-83ee278a4f28 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] [instance: 40e6139b-cfed-4448-b816-1142e9f6f6d5] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:35:36.487962 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-ffea2086-a455-49ee-81ea-83ee278a4f28 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:35:36.489847 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-ffea2086-a455-49ee-81ea-83ee278a4f28 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:35:36.489847 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-ffea2086-a455-49ee-81ea-83ee278a4f28 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:35:36.489847 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-ffea2086-a455-49ee-81ea-83ee278a4f28 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:35:36.514376 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-ffea2086-a455-49ee-81ea-83ee278a4f28 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] [instance: 40e6139b-cfed-4448-b816-1142e9f6f6d5] Going to try to terminate instance {{(pid=117538) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 31 18:35:36.835614 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-ffea2086-a455-49ee-81ea-83ee278a4f28 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] 10.222.0.58 "DELETE /compute/v2.1/servers/40e6139b-cfed-4448-b816-1142e9f6f6d5" status: 204 len: 0 microversion: 2.1 time: 0.358286 Mar 31 18:35:36.836833 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 586/1160] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Mar 31 18:35:36 2022] DELETE /compute/v2.1/servers/40e6139b-cfed-4448-b816-1142e9f6f6d5 => generated 0 bytes in 361 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 31 18:35:36.847215 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-b9f3901b-2fb0-4fa5-a967-2bdbd89e6a89 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:35:36.847899 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-b9f3901b-2fb0-4fa5-a967-2bdbd89e6a89 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] [instance: 40e6139b-cfed-4448-b816-1142e9f6f6d5] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:35:36.854441 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b9f3901b-2fb0-4fa5-a967-2bdbd89e6a89 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:35:36.855002 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b9f3901b-2fb0-4fa5-a967-2bdbd89e6a89 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:35:36.855761 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b9f3901b-2fb0-4fa5-a967-2bdbd89e6a89 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:35:36.856180 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-b9f3901b-2fb0-4fa5-a967-2bdbd89e6a89 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:35:36.993444 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-b9f3901b-2fb0-4fa5-a967-2bdbd89e6a89 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cba9a710d9f4faeb9a267f284223dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d961f71194831954c10d99bcd4e64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:35:37.000711 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-b9f3901b-2fb0-4fa5-a967-2bdbd89e6a89 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] 10.222.0.58 "GET /compute/v2.1/servers/40e6139b-cfed-4448-b816-1142e9f6f6d5" status: 200 len: 1515 microversion: 2.1 time: 0.158428 Mar 31 18:35:37.001266 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 575/1161] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:35:36 2022] GET /compute/v2.1/servers/40e6139b-cfed-4448-b816-1142e9f6f6d5 => generated 1515 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:35:38.018889 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-efbeac41-7bf2-4fa2-8128-80d2983ac835 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:35:38.019583 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-efbeac41-7bf2-4fa2-8128-80d2983ac835 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] [instance: 40e6139b-cfed-4448-b816-1142e9f6f6d5] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:35:38.026755 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-efbeac41-7bf2-4fa2-8128-80d2983ac835 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:35:38.027193 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-efbeac41-7bf2-4fa2-8128-80d2983ac835 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:35:38.027946 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-efbeac41-7bf2-4fa2-8128-80d2983ac835 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:35:38.028373 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-efbeac41-7bf2-4fa2-8128-80d2983ac835 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:35:38.168648 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-efbeac41-7bf2-4fa2-8128-80d2983ac835 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cba9a710d9f4faeb9a267f284223dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d961f71194831954c10d99bcd4e64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:35:38.176039 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-efbeac41-7bf2-4fa2-8128-80d2983ac835 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] 10.222.0.58 "GET /compute/v2.1/servers/40e6139b-cfed-4448-b816-1142e9f6f6d5" status: 200 len: 1515 microversion: 2.1 time: 0.161418 Mar 31 18:35:38.176606 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 587/1162] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:35:38 2022] GET /compute/v2.1/servers/40e6139b-cfed-4448-b816-1142e9f6f6d5 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:35:39.193338 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-0f6c1ea0-ae01-411e-85f2-3321ffc9e3cf tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:35:39.194037 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-0f6c1ea0-ae01-411e-85f2-3321ffc9e3cf tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] [instance: 40e6139b-cfed-4448-b816-1142e9f6f6d5] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:35:39.200418 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0f6c1ea0-ae01-411e-85f2-3321ffc9e3cf tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:35:39.200861 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0f6c1ea0-ae01-411e-85f2-3321ffc9e3cf tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:35:39.201625 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0f6c1ea0-ae01-411e-85f2-3321ffc9e3cf tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:35:39.202055 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0f6c1ea0-ae01-411e-85f2-3321ffc9e3cf tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:35:39.337743 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-0f6c1ea0-ae01-411e-85f2-3321ffc9e3cf tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cba9a710d9f4faeb9a267f284223dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d961f71194831954c10d99bcd4e64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:35:39.345155 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-0f6c1ea0-ae01-411e-85f2-3321ffc9e3cf tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] 10.222.0.58 "GET /compute/v2.1/servers/40e6139b-cfed-4448-b816-1142e9f6f6d5" status: 200 len: 1515 microversion: 2.1 time: 0.155712 Mar 31 18:35:39.351379 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 576/1163] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:35:39 2022] GET /compute/v2.1/servers/40e6139b-cfed-4448-b816-1142e9f6f6d5 => generated 1515 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:35:39.470121 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [req-370d7741-08ec-4228-b222-1844fc8466e7 req-1f23b9e6-31f7-4c97-a3a9-1004ab2bad6c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40e6139b-cfed-4448-b816-1142e9f6f6d5", "name": "network-vif-deleted", "tag": "5cc3bd2c-980d-4f01-a647-0aaa037bd9ae"}]} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:35:39.479695 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-370d7741-08ec-4228-b222-1844fc8466e7 req-1f23b9e6-31f7-4c97-a3a9-1004ab2bad6c service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:35:39.482457 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-370d7741-08ec-4228-b222-1844fc8466e7 req-1f23b9e6-31f7-4c97-a3a9-1004ab2bad6c service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:35:39.493061 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.compute.server_external_events [req-370d7741-08ec-4228-b222-1844fc8466e7 req-1f23b9e6-31f7-4c97-a3a9-1004ab2bad6c service nova] Creating event network-vif-deleted:5cc3bd2c-980d-4f01-a647-0aaa037bd9ae for instance 40e6139b-cfed-4448-b816-1142e9f6f6d5 on hv-cinder-maste Mar 31 18:35:39.498227 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [req-370d7741-08ec-4228-b222-1844fc8466e7 req-1f23b9e6-31f7-4c97-a3a9-1004ab2bad6c service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034753 Mar 31 18:35:39.498842 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 588/1164] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:35:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:35:40.362482 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-07324bca-0ec1-48ff-b29f-79a1249efd1f tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:35:40.363248 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-07324bca-0ec1-48ff-b29f-79a1249efd1f tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] [instance: 40e6139b-cfed-4448-b816-1142e9f6f6d5] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:35:40.369692 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-07324bca-0ec1-48ff-b29f-79a1249efd1f tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:35:40.370124 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-07324bca-0ec1-48ff-b29f-79a1249efd1f tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:35:40.370916 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-07324bca-0ec1-48ff-b29f-79a1249efd1f tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:35:40.371349 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-07324bca-0ec1-48ff-b29f-79a1249efd1f tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:35:40.402457 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-07324bca-0ec1-48ff-b29f-79a1249efd1f tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:35:40.402925 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-07324bca-0ec1-48ff-b29f-79a1249efd1f tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:35:40.403377 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.objects.instance [None req-07324bca-0ec1-48ff-b29f-79a1249efd1f tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lazy-loading 'fault' on Instance uuid 40e6139b-cfed-4448-b816-1142e9f6f6d5 {{(pid=117539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 31 18:35:40.443568 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-07324bca-0ec1-48ff-b29f-79a1249efd1f tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '1cba9a710d9f4faeb9a267f284223dc0', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0f2d961f71194831954c10d99bcd4e64', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:35:40.451051 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-07324bca-0ec1-48ff-b29f-79a1249efd1f tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] 10.222.0.58 "GET /compute/v2.1/servers/40e6139b-cfed-4448-b816-1142e9f6f6d5" status: 200 len: 1309 microversion: 2.1 time: 0.092490 Mar 31 18:35:40.452343 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 577/1165] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:35:40 2022] GET /compute/v2.1/servers/40e6139b-cfed-4448-b816-1142e9f6f6d5 => generated 1309 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:35:41.469077 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-92dce8f0-f0f3-4643-a4aa-0dedfc39c4e0 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:35:41.469759 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-92dce8f0-f0f3-4643-a4aa-0dedfc39c4e0 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] [instance: 40e6139b-cfed-4448-b816-1142e9f6f6d5] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:35:41.476416 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-92dce8f0-f0f3-4643-a4aa-0dedfc39c4e0 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:35:41.476857 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-92dce8f0-f0f3-4643-a4aa-0dedfc39c4e0 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:35:41.477650 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-92dce8f0-f0f3-4643-a4aa-0dedfc39c4e0 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:35:41.478082 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-92dce8f0-f0f3-4643-a4aa-0dedfc39c4e0 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:35:41.490827 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.wsgi [None req-92dce8f0-f0f3-4643-a4aa-0dedfc39c4e0 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] HTTP exception thrown: Instance 40e6139b-cfed-4448-b816-1142e9f6f6d5 could not be found. Mar 31 18:35:41.491645 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-92dce8f0-f0f3-4643-a4aa-0dedfc39c4e0 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] Returning 404 to user: Instance 40e6139b-cfed-4448-b816-1142e9f6f6d5 could not be found. {{(pid=117538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:35:41.492682 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-92dce8f0-f0f3-4643-a4aa-0dedfc39c4e0 tempest-VolumesSnapshotTestJSON-1015225021 tempest-VolumesSnapshotTestJSON-1015225021-project] 10.222.0.58 "GET /compute/v2.1/servers/40e6139b-cfed-4448-b816-1142e9f6f6d5" status: 404 len: 111 microversion: 2.1 time: 0.027801 Mar 31 18:35:41.493218 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 589/1166] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:35:41 2022] GET /compute/v2.1/servers/40e6139b-cfed-4448-b816-1142e9f6f6d5 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 31 18:36:37.774650 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-2e195f42-8ea7-479d-aeac-d3ddd5eda434 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Action: 'create', calling method: .version_select at 0x7fa4d419cb80>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-1436027325"}} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:36:37.790177 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.quota [None req-2e195f42-8ea7-479d-aeac-d3ddd5eda434 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Getting quotas for project 46be7326d5204beeb8c5e499e9d4ac73. Resources: {'key_pairs'} {{(pid=117539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 31 18:36:37.794128 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.quota [None req-2e195f42-8ea7-479d-aeac-d3ddd5eda434 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Getting quotas for user 80b573d868454d74bdd8c7282718c085 and project 46be7326d5204beeb8c5e499e9d4ac73. Resources: {'key_pairs'} {{(pid=117539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 31 18:36:38.175696 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.quota [None req-2e195f42-8ea7-479d-aeac-d3ddd5eda434 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Getting quotas for project 46be7326d5204beeb8c5e499e9d4ac73. Resources: {'key_pairs'} {{(pid=117539) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 31 18:36:38.180062 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.quota [None req-2e195f42-8ea7-479d-aeac-d3ddd5eda434 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Getting quotas for user 80b573d868454d74bdd8c7282718c085 and project 46be7326d5204beeb8c5e499e9d4ac73. Resources: {'key_pairs'} {{(pid=117539) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 31 18:36:38.193201 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-2e195f42-8ea7-479d-aeac-d3ddd5eda434 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] 10.222.0.58 "POST /compute/v2.1/os-keypairs" status: 200 len: 2322 microversion: 2.1 time: 0.422894 Mar 31 18:36:38.194038 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 578/1167] 10.222.0.58 () {60 vars in 1157 bytes} [Thu Mar 31 18:36:37 2022] POST /compute/v2.1/os-keypairs => generated 2322 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:36:38.243762 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-35184941-a61a-41ed-a778-7df58171c9a3 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2017263291", "imageRef": "761871f2-c5d6-4868-beaf-aeed5f044fdf", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-1436027325", "networks": [{"uuid": "47b5a8fc-8543-4316-9b58-da2f4a1b9ec1"}]}} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:36:38.296813 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.network.neutron [None req-35184941-a61a-41ed-a778-7df58171c9a3 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] validate_networks() for [('47b5a8fc-8543-4316-9b58-da2f4a1b9ec1', None, None, None, None, None)] {{(pid=117538) validate_networks /opt/stack/nova/nova/network/neutron.py:2632}} Mar 31 18:36:38.667281 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.virt.hardware [None req-35184941-a61a-41ed-a778-7df58171c9a3 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Flavor limits 0:0:0 {{(pid=117538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Mar 31 18:36:38.667701 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.virt.hardware [None req-35184941-a61a-41ed-a778-7df58171c9a3 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Image limits 0:0:0 {{(pid=117538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Mar 31 18:36:38.668188 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.virt.hardware [None req-35184941-a61a-41ed-a778-7df58171c9a3 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Flavor pref 0:0:0 {{(pid=117538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Mar 31 18:36:38.668591 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.virt.hardware [None req-35184941-a61a-41ed-a778-7df58171c9a3 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Image pref 0:0:0 {{(pid=117538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Mar 31 18:36:38.669029 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.virt.hardware [None req-35184941-a61a-41ed-a778-7df58171c9a3 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117538) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Mar 31 18:36:38.678229 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-35184941-a61a-41ed-a778-7df58171c9a3 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:36:38.678761 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-35184941-a61a-41ed-a778-7df58171c9a3 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:36:38.679589 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-35184941-a61a-41ed-a778-7df58171c9a3 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:36:38.680021 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-35184941-a61a-41ed-a778-7df58171c9a3 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:36:38.696584 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.quota [None req-35184941-a61a-41ed-a778-7df58171c9a3 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Getting quotas for project 46be7326d5204beeb8c5e499e9d4ac73. Resources: {'instances', 'ram', 'cores'} {{(pid=117538) _get_quotas /opt/stack/nova/nova/quota.py:393}} Mar 31 18:36:38.700391 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.quota [None req-35184941-a61a-41ed-a778-7df58171c9a3 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Getting quotas for user 80b573d868454d74bdd8c7282718c085 and project 46be7326d5204beeb8c5e499e9d4ac73. Resources: {'instances', 'ram', 'cores'} {{(pid=117538) _get_quotas /opt/stack/nova/nova/quota.py:383}} Mar 31 18:36:38.711313 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-35184941-a61a-41ed-a778-7df58171c9a3 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Going to run 1 instances... {{(pid=117538) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Mar 31 18:36:38.713460 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-35184941-a61a-41ed-a778-7df58171c9a3 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] [instance: ec1cd9ca-0d6b-409d-a208-8b7a3040fd79] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='761871f2-c5d6-4868-beaf-aeed5f044fdf',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117538) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Mar 31 18:36:38.857559 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-35184941-a61a-41ed-a778-7df58171c9a3 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] 10.222.0.58 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.618508 Mar 31 18:36:38.858199 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 590/1168] 10.222.0.58 () {60 vars in 1146 bytes} [Thu Mar 31 18:36:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Mar 31 18:36:38.869048 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-5fee2401-02c9-400e-8e27-50478d06e078 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:36:38.869816 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-5fee2401-02c9-400e-8e27-50478d06e078 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] [instance: ec1cd9ca-0d6b-409d-a208-8b7a3040fd79] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:36:38.923685 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-5fee2401-02c9-400e-8e27-50478d06e078 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b573d868454d74bdd8c7282718c085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46be7326d5204beeb8c5e499e9d4ac73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:36:38.931320 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-5fee2401-02c9-400e-8e27-50478d06e078 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79" status: 200 len: 1259 microversion: 2.1 time: 0.067278 Mar 31 18:36:38.931878 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 579/1169] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:36:38 2022] GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79 => generated 1259 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:36:39.948893 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-85384c51-e23d-43d5-8e58-2029a71c3f8b tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:36:39.949508 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-85384c51-e23d-43d5-8e58-2029a71c3f8b tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] [instance: ec1cd9ca-0d6b-409d-a208-8b7a3040fd79] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:36:40.007345 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-85384c51-e23d-43d5-8e58-2029a71c3f8b tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b573d868454d74bdd8c7282718c085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46be7326d5204beeb8c5e499e9d4ac73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:36:40.014725 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-85384c51-e23d-43d5-8e58-2029a71c3f8b tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79" status: 200 len: 1259 microversion: 2.1 time: 0.070344 Mar 31 18:36:40.015284 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 591/1170] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:36:39 2022] GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79 => generated 1259 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:36:41.032301 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-f3819a05-9f1d-4a7e-8b04-687dc104adfb tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:36:41.032902 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-f3819a05-9f1d-4a7e-8b04-687dc104adfb tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] [instance: ec1cd9ca-0d6b-409d-a208-8b7a3040fd79] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:36:41.039915 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-f3819a05-9f1d-4a7e-8b04-687dc104adfb tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:36:41.040357 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-f3819a05-9f1d-4a7e-8b04-687dc104adfb tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:36:41.041111 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-f3819a05-9f1d-4a7e-8b04-687dc104adfb tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:36:41.041548 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-f3819a05-9f1d-4a7e-8b04-687dc104adfb tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:36:41.103496 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-f3819a05-9f1d-4a7e-8b04-687dc104adfb tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b573d868454d74bdd8c7282718c085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46be7326d5204beeb8c5e499e9d4ac73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:36:41.111057 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-f3819a05-9f1d-4a7e-8b04-687dc104adfb tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79" status: 200 len: 1311 microversion: 2.1 time: 0.082435 Mar 31 18:36:41.116173 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 580/1171] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:36:41 2022] GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79 => generated 1311 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:36:42.129484 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-2d0cb9f5-8885-48f4-9210-782ce578f978 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:36:42.130226 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-2d0cb9f5-8885-48f4-9210-782ce578f978 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] [instance: ec1cd9ca-0d6b-409d-a208-8b7a3040fd79] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:36:42.137899 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-2d0cb9f5-8885-48f4-9210-782ce578f978 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:36:42.138415 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-2d0cb9f5-8885-48f4-9210-782ce578f978 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:36:42.139396 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-2d0cb9f5-8885-48f4-9210-782ce578f978 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:36:42.140006 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-2d0cb9f5-8885-48f4-9210-782ce578f978 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:36:42.377014 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-2d0cb9f5-8885-48f4-9210-782ce578f978 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b573d868454d74bdd8c7282718c085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46be7326d5204beeb8c5e499e9d4ac73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:36:42.390106 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-2d0cb9f5-8885-48f4-9210-782ce578f978 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79" status: 200 len: 1359 microversion: 2.1 time: 0.264389 Mar 31 18:36:42.401266 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 592/1172] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:36:42 2022] GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79 => generated 1359 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:36:43.413733 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-9a317cf8-6abb-4608-9454-f8e9e359176d tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:36:43.415206 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-9a317cf8-6abb-4608-9454-f8e9e359176d tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] [instance: ec1cd9ca-0d6b-409d-a208-8b7a3040fd79] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:36:43.421451 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9a317cf8-6abb-4608-9454-f8e9e359176d tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:36:43.426807 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9a317cf8-6abb-4608-9454-f8e9e359176d tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:36:43.428510 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9a317cf8-6abb-4608-9454-f8e9e359176d tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:36:43.432235 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9a317cf8-6abb-4608-9454-f8e9e359176d tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:36:43.483994 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [req-49152cbb-be7f-411b-be0c-fe61e52732b9 req-1a6e7303-6766-4868-9e69-08a651198781 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec1cd9ca-0d6b-409d-a208-8b7a3040fd79", "tag": "2c4f0f16-67af-42bd-8b69-094d8a6f726b"}]} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:36:43.501225 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-49152cbb-be7f-411b-be0c-fe61e52732b9 req-1a6e7303-6766-4868-9e69-08a651198781 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:36:43.504556 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-49152cbb-be7f-411b-be0c-fe61e52732b9 req-1a6e7303-6766-4868-9e69-08a651198781 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:36:43.531516 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.compute.server_external_events [req-49152cbb-be7f-411b-be0c-fe61e52732b9 req-1a6e7303-6766-4868-9e69-08a651198781 service nova] Creating event network-changed:2c4f0f16-67af-42bd-8b69-094d8a6f726b for instance ec1cd9ca-0d6b-409d-a208-8b7a3040fd79 on hv-cinder-maste Mar 31 18:36:43.537825 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [req-49152cbb-be7f-411b-be0c-fe61e52732b9 req-1a6e7303-6766-4868-9e69-08a651198781 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.233054 Mar 31 18:36:43.538760 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 581/1173] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:36:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:36:43.632775 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-9a317cf8-6abb-4608-9454-f8e9e359176d tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b573d868454d74bdd8c7282718c085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46be7326d5204beeb8c5e499e9d4ac73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:36:43.639476 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-9a317cf8-6abb-4608-9454-f8e9e359176d tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79" status: 200 len: 1359 microversion: 2.1 time: 0.230136 Mar 31 18:36:43.640029 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 593/1174] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:36:43 2022] GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79 => generated 1359 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:36:44.658998 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-65ee907a-db7a-4edb-8514-7f9fd2fe6210 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:36:44.660957 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-65ee907a-db7a-4edb-8514-7f9fd2fe6210 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] [instance: ec1cd9ca-0d6b-409d-a208-8b7a3040fd79] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:36:44.670835 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-65ee907a-db7a-4edb-8514-7f9fd2fe6210 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:36:44.672041 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-65ee907a-db7a-4edb-8514-7f9fd2fe6210 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:36:44.673132 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-65ee907a-db7a-4edb-8514-7f9fd2fe6210 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:36:44.673869 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-65ee907a-db7a-4edb-8514-7f9fd2fe6210 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:36:44.822291 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-65ee907a-db7a-4edb-8514-7f9fd2fe6210 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b573d868454d74bdd8c7282718c085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46be7326d5204beeb8c5e499e9d4ac73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:36:44.829877 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-65ee907a-db7a-4edb-8514-7f9fd2fe6210 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79" status: 200 len: 1359 microversion: 2.1 time: 0.177030 Mar 31 18:36:44.830440 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 582/1175] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:36:44 2022] GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79 => generated 1359 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:36:45.846930 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-a4272e9f-7628-48e2-9462-5ed2ada31d04 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:36:45.848114 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-a4272e9f-7628-48e2-9462-5ed2ada31d04 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] [instance: ec1cd9ca-0d6b-409d-a208-8b7a3040fd79] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:36:45.853695 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a4272e9f-7628-48e2-9462-5ed2ada31d04 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:36:45.854136 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a4272e9f-7628-48e2-9462-5ed2ada31d04 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:36:45.854947 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a4272e9f-7628-48e2-9462-5ed2ada31d04 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:36:45.855376 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a4272e9f-7628-48e2-9462-5ed2ada31d04 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:36:46.008405 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-a4272e9f-7628-48e2-9462-5ed2ada31d04 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b573d868454d74bdd8c7282718c085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46be7326d5204beeb8c5e499e9d4ac73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:36:46.018856 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-a4272e9f-7628-48e2-9462-5ed2ada31d04 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79" status: 200 len: 1359 microversion: 2.1 time: 0.175231 Mar 31 18:36:46.029658 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 594/1176] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:36:45 2022] GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79 => generated 1359 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:36:47.039489 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-94f68f37-65f8-4347-bf5f-982c98805a9e tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:36:47.041059 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-94f68f37-65f8-4347-bf5f-982c98805a9e tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] [instance: ec1cd9ca-0d6b-409d-a208-8b7a3040fd79] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:36:47.048849 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-94f68f37-65f8-4347-bf5f-982c98805a9e tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:36:47.049708 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-94f68f37-65f8-4347-bf5f-982c98805a9e tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:36:47.050730 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-94f68f37-65f8-4347-bf5f-982c98805a9e tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:36:47.062965 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-94f68f37-65f8-4347-bf5f-982c98805a9e tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:36:47.210784 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-94f68f37-65f8-4347-bf5f-982c98805a9e tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b573d868454d74bdd8c7282718c085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46be7326d5204beeb8c5e499e9d4ac73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:36:47.219523 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-94f68f37-65f8-4347-bf5f-982c98805a9e tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79" status: 200 len: 1359 microversion: 2.1 time: 0.184431 Mar 31 18:36:47.220797 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 583/1177] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:36:47 2022] GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79 => generated 1359 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:36:48.237548 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-8a9e9abb-6079-42aa-a49c-d9c6227673ad tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:36:48.238288 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-8a9e9abb-6079-42aa-a49c-d9c6227673ad tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] [instance: ec1cd9ca-0d6b-409d-a208-8b7a3040fd79] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:36:48.246051 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8a9e9abb-6079-42aa-a49c-d9c6227673ad tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:36:48.246488 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8a9e9abb-6079-42aa-a49c-d9c6227673ad tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:36:48.247352 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8a9e9abb-6079-42aa-a49c-d9c6227673ad tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:36:48.247776 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-8a9e9abb-6079-42aa-a49c-d9c6227673ad tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:36:48.509171 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-8a9e9abb-6079-42aa-a49c-d9c6227673ad tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b573d868454d74bdd8c7282718c085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46be7326d5204beeb8c5e499e9d4ac73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:36:48.509171 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-8a9e9abb-6079-42aa-a49c-d9c6227673ad tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79" status: 200 len: 1359 microversion: 2.1 time: 0.199475 Mar 31 18:36:48.509171 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 595/1178] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:36:48 2022] GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79 => generated 1359 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:36:49.524476 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-e047c6f2-f3e6-4f07-967d-2fcb9f062215 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:36:49.525971 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-e047c6f2-f3e6-4f07-967d-2fcb9f062215 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] [instance: ec1cd9ca-0d6b-409d-a208-8b7a3040fd79] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:36:49.532606 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e047c6f2-f3e6-4f07-967d-2fcb9f062215 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:36:49.533045 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e047c6f2-f3e6-4f07-967d-2fcb9f062215 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:36:49.533906 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e047c6f2-f3e6-4f07-967d-2fcb9f062215 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:36:49.534389 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e047c6f2-f3e6-4f07-967d-2fcb9f062215 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:36:49.670769 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-e047c6f2-f3e6-4f07-967d-2fcb9f062215 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b573d868454d74bdd8c7282718c085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46be7326d5204beeb8c5e499e9d4ac73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:36:49.678061 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-e047c6f2-f3e6-4f07-967d-2fcb9f062215 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79" status: 200 len: 1359 microversion: 2.1 time: 0.158561 Mar 31 18:36:49.678636 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 584/1179] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:36:49 2022] GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:36:50.694868 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-2a9efbc6-5382-4a49-99a7-7a51b03a92fe tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:36:50.695460 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-2a9efbc6-5382-4a49-99a7-7a51b03a92fe tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] [instance: ec1cd9ca-0d6b-409d-a208-8b7a3040fd79] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:36:50.701666 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-2a9efbc6-5382-4a49-99a7-7a51b03a92fe tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:36:50.702101 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-2a9efbc6-5382-4a49-99a7-7a51b03a92fe tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:36:50.702873 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-2a9efbc6-5382-4a49-99a7-7a51b03a92fe tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:36:50.703295 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-2a9efbc6-5382-4a49-99a7-7a51b03a92fe tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:36:50.839535 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-2a9efbc6-5382-4a49-99a7-7a51b03a92fe tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b573d868454d74bdd8c7282718c085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46be7326d5204beeb8c5e499e9d4ac73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:36:50.846661 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-2a9efbc6-5382-4a49-99a7-7a51b03a92fe tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79" status: 200 len: 1359 microversion: 2.1 time: 0.155960 Mar 31 18:36:50.847222 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 596/1180] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:36:50 2022] GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79 => generated 1359 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:36:51.863414 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-8a53705e-fb63-4d87-9010-770de76123df tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:36:51.864014 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-8a53705e-fb63-4d87-9010-770de76123df tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] [instance: ec1cd9ca-0d6b-409d-a208-8b7a3040fd79] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:36:51.870403 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-8a53705e-fb63-4d87-9010-770de76123df tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:36:51.870870 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-8a53705e-fb63-4d87-9010-770de76123df tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:36:51.871616 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-8a53705e-fb63-4d87-9010-770de76123df tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:36:51.872039 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-8a53705e-fb63-4d87-9010-770de76123df tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:36:52.007329 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-8a53705e-fb63-4d87-9010-770de76123df tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b573d868454d74bdd8c7282718c085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46be7326d5204beeb8c5e499e9d4ac73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:36:52.014411 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-8a53705e-fb63-4d87-9010-770de76123df tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79" status: 200 len: 1359 microversion: 2.1 time: 0.154849 Mar 31 18:36:52.014990 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 585/1181] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:36:51 2022] GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:36:53.032842 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-e5522a19-5e59-40f3-a45e-749dbccda646 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:36:53.033396 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-e5522a19-5e59-40f3-a45e-749dbccda646 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] [instance: ec1cd9ca-0d6b-409d-a208-8b7a3040fd79] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:36:53.040100 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e5522a19-5e59-40f3-a45e-749dbccda646 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:36:53.040538 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e5522a19-5e59-40f3-a45e-749dbccda646 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:36:53.041293 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e5522a19-5e59-40f3-a45e-749dbccda646 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:36:53.041719 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e5522a19-5e59-40f3-a45e-749dbccda646 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:36:53.263490 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-e5522a19-5e59-40f3-a45e-749dbccda646 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b573d868454d74bdd8c7282718c085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46be7326d5204beeb8c5e499e9d4ac73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:36:53.271045 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-e5522a19-5e59-40f3-a45e-749dbccda646 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79" status: 200 len: 1359 microversion: 2.1 time: 0.242741 Mar 31 18:36:53.272230 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 597/1182] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:36:53 2022] GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79 => generated 1359 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:36:54.289140 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-2b1efb80-94f3-4db0-8bae-7e570323128e tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:36:54.289744 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-2b1efb80-94f3-4db0-8bae-7e570323128e tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] [instance: ec1cd9ca-0d6b-409d-a208-8b7a3040fd79] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:36:54.296710 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-2b1efb80-94f3-4db0-8bae-7e570323128e tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:36:54.297146 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-2b1efb80-94f3-4db0-8bae-7e570323128e tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:36:54.297899 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-2b1efb80-94f3-4db0-8bae-7e570323128e tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:36:54.298323 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-2b1efb80-94f3-4db0-8bae-7e570323128e tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:36:54.431675 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-2b1efb80-94f3-4db0-8bae-7e570323128e tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b573d868454d74bdd8c7282718c085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46be7326d5204beeb8c5e499e9d4ac73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:36:54.438803 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-2b1efb80-94f3-4db0-8bae-7e570323128e tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79" status: 200 len: 1359 microversion: 2.1 time: 0.153672 Mar 31 18:36:54.439349 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 586/1183] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:36:54 2022] GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79 => generated 1359 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:36:55.455583 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-21063282-bc86-4528-9f05-2c7d5f18334c tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:36:55.456189 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-21063282-bc86-4528-9f05-2c7d5f18334c tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] [instance: ec1cd9ca-0d6b-409d-a208-8b7a3040fd79] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:36:55.462439 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-21063282-bc86-4528-9f05-2c7d5f18334c tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:36:55.462935 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-21063282-bc86-4528-9f05-2c7d5f18334c tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:36:55.463690 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-21063282-bc86-4528-9f05-2c7d5f18334c tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:36:55.464112 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-21063282-bc86-4528-9f05-2c7d5f18334c tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:36:55.597214 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-21063282-bc86-4528-9f05-2c7d5f18334c tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b573d868454d74bdd8c7282718c085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46be7326d5204beeb8c5e499e9d4ac73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:36:55.604889 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-21063282-bc86-4528-9f05-2c7d5f18334c tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79" status: 200 len: 1359 microversion: 2.1 time: 0.153340 Mar 31 18:36:55.605444 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 598/1184] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:36:55 2022] GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79 => generated 1359 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:36:56.621368 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-3b8e6963-9f72-4769-8be9-93a650a8dc4f tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:36:56.621969 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-3b8e6963-9f72-4769-8be9-93a650a8dc4f tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] [instance: ec1cd9ca-0d6b-409d-a208-8b7a3040fd79] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:36:56.628820 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3b8e6963-9f72-4769-8be9-93a650a8dc4f tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:36:56.629262 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3b8e6963-9f72-4769-8be9-93a650a8dc4f tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:36:56.630018 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3b8e6963-9f72-4769-8be9-93a650a8dc4f tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:36:56.631673 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3b8e6963-9f72-4769-8be9-93a650a8dc4f tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:36:56.764465 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-3b8e6963-9f72-4769-8be9-93a650a8dc4f tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b573d868454d74bdd8c7282718c085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46be7326d5204beeb8c5e499e9d4ac73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:36:56.772441 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-3b8e6963-9f72-4769-8be9-93a650a8dc4f tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79" status: 200 len: 1359 microversion: 2.1 time: 0.154961 Mar 31 18:36:56.773012 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 587/1185] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:36:56 2022] GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79 => generated 1359 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:36:57.789273 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-43a07162-aae7-45cd-9d5f-2224da6549f8 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:36:57.789876 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-43a07162-aae7-45cd-9d5f-2224da6549f8 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] [instance: ec1cd9ca-0d6b-409d-a208-8b7a3040fd79] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:36:57.796163 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-43a07162-aae7-45cd-9d5f-2224da6549f8 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:36:57.796591 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-43a07162-aae7-45cd-9d5f-2224da6549f8 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:36:57.797343 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-43a07162-aae7-45cd-9d5f-2224da6549f8 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:36:57.797765 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-43a07162-aae7-45cd-9d5f-2224da6549f8 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:36:57.936897 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-43a07162-aae7-45cd-9d5f-2224da6549f8 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b573d868454d74bdd8c7282718c085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46be7326d5204beeb8c5e499e9d4ac73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:36:57.944906 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-43a07162-aae7-45cd-9d5f-2224da6549f8 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79" status: 200 len: 1359 microversion: 2.1 time: 0.160005 Mar 31 18:36:57.945468 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 599/1186] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:36:57 2022] GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79 => generated 1359 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:36:58.961366 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-5b35dc0f-a31d-4e4d-84fe-1f312c26b3f7 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:36:58.961934 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-5b35dc0f-a31d-4e4d-84fe-1f312c26b3f7 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] [instance: ec1cd9ca-0d6b-409d-a208-8b7a3040fd79] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:36:58.968094 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-5b35dc0f-a31d-4e4d-84fe-1f312c26b3f7 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:36:58.968535 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-5b35dc0f-a31d-4e4d-84fe-1f312c26b3f7 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:36:58.969310 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-5b35dc0f-a31d-4e4d-84fe-1f312c26b3f7 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:36:58.969740 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-5b35dc0f-a31d-4e4d-84fe-1f312c26b3f7 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:36:59.107435 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-5b35dc0f-a31d-4e4d-84fe-1f312c26b3f7 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b573d868454d74bdd8c7282718c085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46be7326d5204beeb8c5e499e9d4ac73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:36:59.114832 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-5b35dc0f-a31d-4e4d-84fe-1f312c26b3f7 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79" status: 200 len: 1359 microversion: 2.1 time: 0.157433 Mar 31 18:36:59.116594 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 588/1187] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:36:58 2022] GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79 => generated 1359 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:37:00.134198 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-bf12bb0e-7350-4154-802f-84e6ec1d08d8 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:37:00.134855 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-bf12bb0e-7350-4154-802f-84e6ec1d08d8 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] [instance: ec1cd9ca-0d6b-409d-a208-8b7a3040fd79] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:37:00.141306 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-bf12bb0e-7350-4154-802f-84e6ec1d08d8 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:37:00.141744 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-bf12bb0e-7350-4154-802f-84e6ec1d08d8 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:37:00.142511 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-bf12bb0e-7350-4154-802f-84e6ec1d08d8 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:37:00.142994 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-bf12bb0e-7350-4154-802f-84e6ec1d08d8 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:37:00.292225 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-bf12bb0e-7350-4154-802f-84e6ec1d08d8 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b573d868454d74bdd8c7282718c085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46be7326d5204beeb8c5e499e9d4ac73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:37:00.302323 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-bf12bb0e-7350-4154-802f-84e6ec1d08d8 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79" status: 200 len: 1359 microversion: 2.1 time: 0.170607 Mar 31 18:37:00.302323 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 600/1188] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:37:00 2022] GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79 => generated 1359 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:37:01.315487 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-cd5adb54-0b62-45d5-be84-e26997f9e8f3 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:37:01.316105 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-cd5adb54-0b62-45d5-be84-e26997f9e8f3 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] [instance: ec1cd9ca-0d6b-409d-a208-8b7a3040fd79] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:37:01.322481 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-cd5adb54-0b62-45d5-be84-e26997f9e8f3 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:37:01.322982 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-cd5adb54-0b62-45d5-be84-e26997f9e8f3 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:37:01.323739 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-cd5adb54-0b62-45d5-be84-e26997f9e8f3 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:37:01.324171 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-cd5adb54-0b62-45d5-be84-e26997f9e8f3 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:37:01.471718 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-cd5adb54-0b62-45d5-be84-e26997f9e8f3 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b573d868454d74bdd8c7282718c085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46be7326d5204beeb8c5e499e9d4ac73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:37:01.480796 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-cd5adb54-0b62-45d5-be84-e26997f9e8f3 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79" status: 200 len: 1359 microversion: 2.1 time: 0.169207 Mar 31 18:37:01.481392 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 589/1189] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:37:01 2022] GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79 => generated 1359 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:37:01.751590 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [req-0a2e25b0-cb2a-4ffc-a3db-3cd38669f4fc req-2a7d5437-b389-4f5d-ae2c-3d575f5cb4c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec1cd9ca-0d6b-409d-a208-8b7a3040fd79", "name": "network-vif-plugged", "status": "completed", "tag": "2c4f0f16-67af-42bd-8b69-094d8a6f726b"}]} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:37:01.760281 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-0a2e25b0-cb2a-4ffc-a3db-3cd38669f4fc req-2a7d5437-b389-4f5d-ae2c-3d575f5cb4c8 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:37:01.760716 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-0a2e25b0-cb2a-4ffc-a3db-3cd38669f4fc req-2a7d5437-b389-4f5d-ae2c-3d575f5cb4c8 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:37:01.772825 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.compute.server_external_events [req-0a2e25b0-cb2a-4ffc-a3db-3cd38669f4fc req-2a7d5437-b389-4f5d-ae2c-3d575f5cb4c8 service nova] Creating event network-vif-plugged:2c4f0f16-67af-42bd-8b69-094d8a6f726b for instance ec1cd9ca-0d6b-409d-a208-8b7a3040fd79 on hv-cinder-maste Mar 31 18:37:01.778835 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [req-0a2e25b0-cb2a-4ffc-a3db-3cd38669f4fc req-2a7d5437-b389-4f5d-ae2c-3d575f5cb4c8 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121948 Mar 31 18:37:01.779503 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 601/1190] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:37:02.504308 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-5dd4a32c-3954-4d3f-bfb0-c59a7aaa55ac tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:37:02.504909 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-5dd4a32c-3954-4d3f-bfb0-c59a7aaa55ac tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] [instance: ec1cd9ca-0d6b-409d-a208-8b7a3040fd79] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:37:02.511344 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-5dd4a32c-3954-4d3f-bfb0-c59a7aaa55ac tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:37:02.511782 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-5dd4a32c-3954-4d3f-bfb0-c59a7aaa55ac tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:37:02.512539 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-5dd4a32c-3954-4d3f-bfb0-c59a7aaa55ac tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:37:02.512965 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-5dd4a32c-3954-4d3f-bfb0-c59a7aaa55ac tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:37:02.658393 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-5dd4a32c-3954-4d3f-bfb0-c59a7aaa55ac tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b573d868454d74bdd8c7282718c085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46be7326d5204beeb8c5e499e9d4ac73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:37:02.667586 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-5dd4a32c-3954-4d3f-bfb0-c59a7aaa55ac tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79" status: 200 len: 1359 microversion: 2.1 time: 0.167052 Mar 31 18:37:02.668280 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 590/1191] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:37:02 2022] GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79 => generated 1359 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:37:03.685094 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-e7b23af8-215a-4f11-9718-4dbaf3fab6ad tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:37:03.685781 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-e7b23af8-215a-4f11-9718-4dbaf3fab6ad tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] [instance: ec1cd9ca-0d6b-409d-a208-8b7a3040fd79] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:37:03.692181 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e7b23af8-215a-4f11-9718-4dbaf3fab6ad tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:37:03.692618 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e7b23af8-215a-4f11-9718-4dbaf3fab6ad tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:37:03.693946 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e7b23af8-215a-4f11-9718-4dbaf3fab6ad tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:37:03.694369 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-e7b23af8-215a-4f11-9718-4dbaf3fab6ad tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:37:03.831719 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-e7b23af8-215a-4f11-9718-4dbaf3fab6ad tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b573d868454d74bdd8c7282718c085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46be7326d5204beeb8c5e499e9d4ac73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:37:03.838942 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-e7b23af8-215a-4f11-9718-4dbaf3fab6ad tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79" status: 200 len: 1359 microversion: 2.1 time: 0.158064 Mar 31 18:37:03.844926 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 602/1192] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:37:03 2022] GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79 => generated 1359 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:37:04.004759 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 31 18:37:04.005354 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: Thu Mar 31 18:37:04 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 31 18:37:04.856356 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-e221f5e1-d8cf-4593-8c0b-307617eceb2b tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:37:04.856985 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-e221f5e1-d8cf-4593-8c0b-307617eceb2b tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] [instance: ec1cd9ca-0d6b-409d-a208-8b7a3040fd79] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:37:04.863385 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e221f5e1-d8cf-4593-8c0b-307617eceb2b tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:37:04.863828 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e221f5e1-d8cf-4593-8c0b-307617eceb2b tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:37:04.864596 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e221f5e1-d8cf-4593-8c0b-307617eceb2b tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:37:04.865028 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-e221f5e1-d8cf-4593-8c0b-307617eceb2b tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:37:05.015848 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-e221f5e1-d8cf-4593-8c0b-307617eceb2b tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b573d868454d74bdd8c7282718c085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46be7326d5204beeb8c5e499e9d4ac73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:37:05.023583 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-e221f5e1-d8cf-4593-8c0b-307617eceb2b tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79" status: 200 len: 1548 microversion: 2.1 time: 0.171142 Mar 31 18:37:05.024149 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 591/1193] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:37:04 2022] GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79 => generated 1548 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:37:05.040403 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-4401e660-e8a5-44b3-995d-166a6ede5df2 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:37:05.041012 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-4401e660-e8a5-44b3-995d-166a6ede5df2 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] [instance: ec1cd9ca-0d6b-409d-a208-8b7a3040fd79] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:37:05.047741 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4401e660-e8a5-44b3-995d-166a6ede5df2 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:37:05.048188 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4401e660-e8a5-44b3-995d-166a6ede5df2 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:37:05.048947 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4401e660-e8a5-44b3-995d-166a6ede5df2 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:37:05.049391 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4401e660-e8a5-44b3-995d-166a6ede5df2 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:37:05.181333 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-4401e660-e8a5-44b3-995d-166a6ede5df2 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b573d868454d74bdd8c7282718c085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46be7326d5204beeb8c5e499e9d4ac73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:37:05.188726 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-4401e660-e8a5-44b3-995d-166a6ede5df2 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79" status: 200 len: 1548 microversion: 2.1 time: 0.152407 Mar 31 18:37:05.189294 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 603/1194] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:37:05 2022] GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79 => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:37:05.205101 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-73fb8cfd-f622-4fbe-a29f-e107712ee6eb tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:37:05.208503 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-73fb8cfd-f622-4fbe-a29f-e107712ee6eb tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '80b573d868454d74bdd8c7282718c085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46be7326d5204beeb8c5e499e9d4ac73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:37:05.209625 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-73fb8cfd-f622-4fbe-a29f-e107712ee6eb tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Searching by: {'deleted': False, 'project_id': '46be7326d5204beeb8c5e499e9d4ac73'} {{(pid=117539) get_all /opt/stack/nova/nova/compute/api.py:2960}} Mar 31 18:37:05.216106 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-73fb8cfd-f622-4fbe-a29f-e107712ee6eb tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:37:05.216537 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-73fb8cfd-f622-4fbe-a29f-e107712ee6eb tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:37:05.217315 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-73fb8cfd-f622-4fbe-a29f-e107712ee6eb tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:37:05.217735 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-73fb8cfd-f622-4fbe-a29f-e107712ee6eb tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:37:05.307379 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.multi_cell_list [None req-73fb8cfd-f622-4fbe-a29f-e107712ee6eb tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117539) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Mar 31 18:37:05.401957 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-73fb8cfd-f622-4fbe-a29f-e107712ee6eb tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] 10.222.0.58 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.200483 Mar 31 18:37:05.402445 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 592/1195] 10.222.0.58 () {58 vars in 1124 bytes} [Thu Mar 31 18:37:05 2022] GET /compute/v2.1/servers => generated 343 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:37:05.413382 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-fb9ab275-0bb3-46ad-af7f-e02efd1d185b tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:37:05.413996 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-fb9ab275-0bb3-46ad-af7f-e02efd1d185b tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] [instance: ec1cd9ca-0d6b-409d-a208-8b7a3040fd79] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:37:05.419795 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-fb9ab275-0bb3-46ad-af7f-e02efd1d185b tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:37:05.420304 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-fb9ab275-0bb3-46ad-af7f-e02efd1d185b tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:37:05.421035 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-fb9ab275-0bb3-46ad-af7f-e02efd1d185b tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:37:05.421458 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-fb9ab275-0bb3-46ad-af7f-e02efd1d185b tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:37:05.556678 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-fb9ab275-0bb3-46ad-af7f-e02efd1d185b tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b573d868454d74bdd8c7282718c085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46be7326d5204beeb8c5e499e9d4ac73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:37:05.568521 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-fb9ab275-0bb3-46ad-af7f-e02efd1d185b tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79" status: 200 len: 1548 microversion: 2.1 time: 0.155168 Mar 31 18:37:05.568521 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 604/1196] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:37:05 2022] GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79 => generated 1548 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:37:07.580181 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-115f11e7-cb13-4efd-ab02-cd441fae6984 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "aa379bdb-8cb8-4904-8dc5-eb0978e864fe"}} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:37:07.581298 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-115f11e7-cb13-4efd-ab02-cd441fae6984 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] [instance: ec1cd9ca-0d6b-409d-a208-8b7a3040fd79] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:37:07.588347 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-115f11e7-cb13-4efd-ab02-cd441fae6984 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:37:07.588786 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-115f11e7-cb13-4efd-ab02-cd441fae6984 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:37:07.589538 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-115f11e7-cb13-4efd-ab02-cd441fae6984 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:37:07.589965 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-115f11e7-cb13-4efd-ab02-cd441fae6984 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:37:08.323314 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-115f11e7-cb13-4efd-ab02-cd441fae6984 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] 10.222.0.58 "POST /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.746937 Mar 31 18:37:08.324205 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 593/1197] 10.222.0.58 () {60 vars in 1322 bytes} [Thu Mar 31 18:37:07 2022] POST /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79/os-volume_attachments => generated 194 bytes in 748 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:37:11.945699 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 31 18:37:11.946302 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: Thu Mar 31 18:37:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 31 18:37:16.916527 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-238d8c37-940d-49f7-979f-fdf2787a7363 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:37:16.917190 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-238d8c37-940d-49f7-979f-fdf2787a7363 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] [instance: ec1cd9ca-0d6b-409d-a208-8b7a3040fd79] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:37:16.923221 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-238d8c37-940d-49f7-979f-fdf2787a7363 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:37:16.923664 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-238d8c37-940d-49f7-979f-fdf2787a7363 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:37:16.924424 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-238d8c37-940d-49f7-979f-fdf2787a7363 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:37:16.924853 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-238d8c37-940d-49f7-979f-fdf2787a7363 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:37:17.066826 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-238d8c37-940d-49f7-979f-fdf2787a7363 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b573d868454d74bdd8c7282718c085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46be7326d5204beeb8c5e499e9d4ac73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:37:17.074794 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-238d8c37-940d-49f7-979f-fdf2787a7363 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79" status: 200 len: 1594 microversion: 2.1 time: 0.162187 Mar 31 18:37:17.075374 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 605/1198] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:37:16 2022] GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79 => generated 1594 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:37:19.523003 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [req-7b58adaa-9858-4769-adcb-e6a741c5c502 req-3840b6b2-6e02-4655-b793-c861ffe90677 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec1cd9ca-0d6b-409d-a208-8b7a3040fd79", "tag": "2c4f0f16-67af-42bd-8b69-094d8a6f726b"}]} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:37:19.533293 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-7b58adaa-9858-4769-adcb-e6a741c5c502 req-3840b6b2-6e02-4655-b793-c861ffe90677 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:37:19.533829 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-7b58adaa-9858-4769-adcb-e6a741c5c502 req-3840b6b2-6e02-4655-b793-c861ffe90677 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:37:19.548165 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.compute.server_external_events [req-7b58adaa-9858-4769-adcb-e6a741c5c502 req-3840b6b2-6e02-4655-b793-c861ffe90677 service nova] Creating event network-changed:2c4f0f16-67af-42bd-8b69-094d8a6f726b for instance ec1cd9ca-0d6b-409d-a208-8b7a3040fd79 on hv-cinder-maste Mar 31 18:37:19.553420 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [req-7b58adaa-9858-4769-adcb-e6a741c5c502 req-3840b6b2-6e02-4655-b793-c861ffe90677 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034830 Mar 31 18:37:19.554333 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 594/1199] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:37:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:37:22.234802 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-a1556a53-f0b2-4512-b348-28de6da6f444 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-123221379"}} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:37:22.234802 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-a1556a53-f0b2-4512-b348-28de6da6f444 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] [instance: ec1cd9ca-0d6b-409d-a208-8b7a3040fd79] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:37:22.239906 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a1556a53-f0b2-4512-b348-28de6da6f444 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:37:22.239906 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a1556a53-f0b2-4512-b348-28de6da6f444 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:37:22.240160 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a1556a53-f0b2-4512-b348-28de6da6f444 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:37:22.240591 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a1556a53-f0b2-4512-b348-28de6da6f444 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:37:22.378171 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.network.security_group_api [None req-a1556a53-f0b2-4512-b348-28de6da6f444 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Adding security group 77a390dc-70c2-4ea5-9ee2-921b2ac634c8 to port 2c4f0f16-67af-42bd-8b69-094d8a6f726b Mar 31 18:37:22.805762 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-a1556a53-f0b2-4512-b348-28de6da6f444 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] 10.222.0.58 "POST /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79/action" status: 202 len: 0 microversion: 2.1 time: 0.578248 Mar 31 18:37:22.815383 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [req-e2eb3a08-114d-44c0-97cf-ee67a9f4386c req-72ab5b1a-87af-467f-86ff-dd8f64d48be7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec1cd9ca-0d6b-409d-a208-8b7a3040fd79", "tag": "2c4f0f16-67af-42bd-8b69-094d8a6f726b"}]} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:37:22.817527 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 606/1200] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Mar 31 18:37:22 2022] POST /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79/action => generated 0 bytes in 591 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 31 18:37:22.855391 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-e2eb3a08-114d-44c0-97cf-ee67a9f4386c req-72ab5b1a-87af-467f-86ff-dd8f64d48be7 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:37:22.855391 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-e2eb3a08-114d-44c0-97cf-ee67a9f4386c req-72ab5b1a-87af-467f-86ff-dd8f64d48be7 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:37:22.855711 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-a1950236-e334-4318-9115-053a7af3f8d0 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:37:22.855711 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-a1950236-e334-4318-9115-053a7af3f8d0 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] [instance: ec1cd9ca-0d6b-409d-a208-8b7a3040fd79] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:37:22.855711 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a1950236-e334-4318-9115-053a7af3f8d0 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:37:22.855711 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a1950236-e334-4318-9115-053a7af3f8d0 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:37:22.856108 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a1950236-e334-4318-9115-053a7af3f8d0 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:37:22.856108 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a1950236-e334-4318-9115-053a7af3f8d0 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:37:22.858908 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.compute.server_external_events [req-e2eb3a08-114d-44c0-97cf-ee67a9f4386c req-72ab5b1a-87af-467f-86ff-dd8f64d48be7 service nova] Creating event network-changed:2c4f0f16-67af-42bd-8b69-094d8a6f726b for instance ec1cd9ca-0d6b-409d-a208-8b7a3040fd79 on hv-cinder-maste Mar 31 18:37:22.866749 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [req-e2eb3a08-114d-44c0-97cf-ee67a9f4386c req-72ab5b1a-87af-467f-86ff-dd8f64d48be7 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056325 Mar 31 18:37:22.868306 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 595/1201] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:37:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:37:23.152457 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-a1950236-e334-4318-9115-053a7af3f8d0 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b573d868454d74bdd8c7282718c085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46be7326d5204beeb8c5e499e9d4ac73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:37:23.163881 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-a1950236-e334-4318-9115-053a7af3f8d0 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79" status: 200 len: 1759 microversion: 2.1 time: 0.344734 Mar 31 18:37:23.164695 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 607/1202] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:37:22 2022] GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79 => generated 1759 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:38:20.617605 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-c02c2250-a1de-4b1b-aa63-49fa6504787b tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:38:20.618624 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-c02c2250-a1de-4b1b-aa63-49fa6504787b tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] [instance: ec1cd9ca-0d6b-409d-a208-8b7a3040fd79] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:38:20.625168 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c02c2250-a1de-4b1b-aa63-49fa6504787b tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:38:20.625606 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c02c2250-a1de-4b1b-aa63-49fa6504787b tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:38:20.626352 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c02c2250-a1de-4b1b-aa63-49fa6504787b tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:38:20.626809 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-c02c2250-a1de-4b1b-aa63-49fa6504787b tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:38:20.871030 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-c02c2250-a1de-4b1b-aa63-49fa6504787b tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] 10.222.0.58 "POST /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79/action" status: 202 len: 0 microversion: 2.1 time: 0.257323 Mar 31 18:38:20.871684 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 596/1203] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Mar 31 18:38:20 2022] POST /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79/action => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 31 18:38:20.880254 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-fc77527c-ae0b-4e5f-81ab-3e824c35ef7c tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:38:20.880914 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-fc77527c-ae0b-4e5f-81ab-3e824c35ef7c tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] [instance: ec1cd9ca-0d6b-409d-a208-8b7a3040fd79] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:38:20.887586 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-fc77527c-ae0b-4e5f-81ab-3e824c35ef7c tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:38:20.888314 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-fc77527c-ae0b-4e5f-81ab-3e824c35ef7c tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:38:20.889112 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-fc77527c-ae0b-4e5f-81ab-3e824c35ef7c tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:38:20.889557 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-fc77527c-ae0b-4e5f-81ab-3e824c35ef7c tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:38:21.100960 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-fc77527c-ae0b-4e5f-81ab-3e824c35ef7c tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b573d868454d74bdd8c7282718c085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46be7326d5204beeb8c5e499e9d4ac73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:38:21.109334 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-fc77527c-ae0b-4e5f-81ab-3e824c35ef7c tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79" status: 200 len: 1751 microversion: 2.1 time: 0.233526 Mar 31 18:38:21.110161 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 608/1204] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:38:20 2022] GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79 => generated 1751 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:38:22.129530 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-80dcabad-00f5-4c33-8fe0-2e45f56ebd91 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:38:22.130249 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-80dcabad-00f5-4c33-8fe0-2e45f56ebd91 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] [instance: ec1cd9ca-0d6b-409d-a208-8b7a3040fd79] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:38:22.136422 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-80dcabad-00f5-4c33-8fe0-2e45f56ebd91 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:38:22.136867 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-80dcabad-00f5-4c33-8fe0-2e45f56ebd91 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:38:22.137627 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-80dcabad-00f5-4c33-8fe0-2e45f56ebd91 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:38:22.138080 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-80dcabad-00f5-4c33-8fe0-2e45f56ebd91 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:38:22.288470 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-80dcabad-00f5-4c33-8fe0-2e45f56ebd91 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b573d868454d74bdd8c7282718c085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46be7326d5204beeb8c5e499e9d4ac73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:38:22.296267 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-80dcabad-00f5-4c33-8fe0-2e45f56ebd91 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79" status: 200 len: 1756 microversion: 2.1 time: 0.172178 Mar 31 18:38:22.296838 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 597/1205] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:38:22 2022] GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79 => generated 1756 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:38:23.314206 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-4f4f1ec1-b79d-4295-a2cf-fa5a43a1a121 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:38:23.314794 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-4f4f1ec1-b79d-4295-a2cf-fa5a43a1a121 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] [instance: ec1cd9ca-0d6b-409d-a208-8b7a3040fd79] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:38:23.321809 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4f4f1ec1-b79d-4295-a2cf-fa5a43a1a121 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:38:23.322261 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4f4f1ec1-b79d-4295-a2cf-fa5a43a1a121 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:38:23.323055 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4f4f1ec1-b79d-4295-a2cf-fa5a43a1a121 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:38:23.323490 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-4f4f1ec1-b79d-4295-a2cf-fa5a43a1a121 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:38:23.475177 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-4f4f1ec1-b79d-4295-a2cf-fa5a43a1a121 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b573d868454d74bdd8c7282718c085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46be7326d5204beeb8c5e499e9d4ac73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:38:23.482964 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-4f4f1ec1-b79d-4295-a2cf-fa5a43a1a121 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79" status: 200 len: 1756 microversion: 2.1 time: 0.172882 Mar 31 18:38:23.483526 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 609/1206] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:38:23 2022] GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:38:24.500407 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-0993aae4-7f2a-45d1-9856-1401541efca4 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:38:24.501016 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-0993aae4-7f2a-45d1-9856-1401541efca4 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] [instance: ec1cd9ca-0d6b-409d-a208-8b7a3040fd79] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:38:24.507979 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0993aae4-7f2a-45d1-9856-1401541efca4 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:38:24.508426 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0993aae4-7f2a-45d1-9856-1401541efca4 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:38:24.509186 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0993aae4-7f2a-45d1-9856-1401541efca4 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:38:24.509615 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-0993aae4-7f2a-45d1-9856-1401541efca4 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:38:24.661206 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-0993aae4-7f2a-45d1-9856-1401541efca4 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b573d868454d74bdd8c7282718c085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46be7326d5204beeb8c5e499e9d4ac73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:38:24.669086 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-0993aae4-7f2a-45d1-9856-1401541efca4 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79" status: 200 len: 1756 microversion: 2.1 time: 0.172871 Mar 31 18:38:24.669655 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 598/1207] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:38:24 2022] GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:38:25.686839 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-c076744b-ae01-4938-8a48-330ac6d12fe4 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:38:25.687736 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-c076744b-ae01-4938-8a48-330ac6d12fe4 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] [instance: ec1cd9ca-0d6b-409d-a208-8b7a3040fd79] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:38:25.694207 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c076744b-ae01-4938-8a48-330ac6d12fe4 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:38:25.694678 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c076744b-ae01-4938-8a48-330ac6d12fe4 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:38:25.695459 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c076744b-ae01-4938-8a48-330ac6d12fe4 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:38:25.695893 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-c076744b-ae01-4938-8a48-330ac6d12fe4 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:38:25.848311 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-c076744b-ae01-4938-8a48-330ac6d12fe4 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b573d868454d74bdd8c7282718c085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46be7326d5204beeb8c5e499e9d4ac73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:38:25.856148 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-c076744b-ae01-4938-8a48-330ac6d12fe4 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79" status: 200 len: 1756 microversion: 2.1 time: 0.173363 Mar 31 18:38:25.856704 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 610/1208] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:38:25 2022] GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79 => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:38:26.874817 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-20d9df9b-49b8-44aa-9db4-7cae78e9ba19 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:38:26.875424 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-20d9df9b-49b8-44aa-9db4-7cae78e9ba19 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] [instance: ec1cd9ca-0d6b-409d-a208-8b7a3040fd79] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:38:26.882361 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-20d9df9b-49b8-44aa-9db4-7cae78e9ba19 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:38:26.882843 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-20d9df9b-49b8-44aa-9db4-7cae78e9ba19 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:38:26.883596 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-20d9df9b-49b8-44aa-9db4-7cae78e9ba19 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:38:26.884020 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-20d9df9b-49b8-44aa-9db4-7cae78e9ba19 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:38:27.036607 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-20d9df9b-49b8-44aa-9db4-7cae78e9ba19 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b573d868454d74bdd8c7282718c085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46be7326d5204beeb8c5e499e9d4ac73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:38:27.044353 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-20d9df9b-49b8-44aa-9db4-7cae78e9ba19 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79" status: 200 len: 1756 microversion: 2.1 time: 0.173486 Mar 31 18:38:27.044925 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 599/1209] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:38:26 2022] GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79 => generated 1756 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:38:28.063938 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-7a40a234-2e5c-4224-b3aa-1f8322ddeb59 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:38:28.064559 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-7a40a234-2e5c-4224-b3aa-1f8322ddeb59 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] [instance: ec1cd9ca-0d6b-409d-a208-8b7a3040fd79] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:38:28.072908 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-7a40a234-2e5c-4224-b3aa-1f8322ddeb59 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:38:28.073717 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-7a40a234-2e5c-4224-b3aa-1f8322ddeb59 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:38:28.075132 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-7a40a234-2e5c-4224-b3aa-1f8322ddeb59 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:38:28.075842 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-7a40a234-2e5c-4224-b3aa-1f8322ddeb59 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:38:28.226739 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-7a40a234-2e5c-4224-b3aa-1f8322ddeb59 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b573d868454d74bdd8c7282718c085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46be7326d5204beeb8c5e499e9d4ac73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:38:28.231412 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-7a40a234-2e5c-4224-b3aa-1f8322ddeb59 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79" status: 200 len: 1756 microversion: 2.1 time: 0.172729 Mar 31 18:38:28.231977 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 611/1210] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:38:28 2022] GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79 => generated 1756 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:38:29.249123 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-231f3665-b8b2-4870-ae1f-2dd0322a67c8 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:38:29.249738 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-231f3665-b8b2-4870-ae1f-2dd0322a67c8 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] [instance: ec1cd9ca-0d6b-409d-a208-8b7a3040fd79] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:38:29.259240 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-231f3665-b8b2-4870-ae1f-2dd0322a67c8 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:38:29.259240 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-231f3665-b8b2-4870-ae1f-2dd0322a67c8 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:38:29.259240 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-231f3665-b8b2-4870-ae1f-2dd0322a67c8 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:38:29.259240 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-231f3665-b8b2-4870-ae1f-2dd0322a67c8 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:38:29.404365 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-231f3665-b8b2-4870-ae1f-2dd0322a67c8 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b573d868454d74bdd8c7282718c085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46be7326d5204beeb8c5e499e9d4ac73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:38:29.412646 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-231f3665-b8b2-4870-ae1f-2dd0322a67c8 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79" status: 200 len: 1756 microversion: 2.1 time: 0.167401 Mar 31 18:38:29.413218 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 600/1211] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:38:29 2022] GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79 => generated 1756 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:38:30.430786 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-9164f188-610b-4e09-8701-a28a982afe7b tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:38:30.431348 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-9164f188-610b-4e09-8701-a28a982afe7b tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] [instance: ec1cd9ca-0d6b-409d-a208-8b7a3040fd79] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:38:30.437710 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9164f188-610b-4e09-8701-a28a982afe7b tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:38:30.438155 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9164f188-610b-4e09-8701-a28a982afe7b tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:38:30.438948 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9164f188-610b-4e09-8701-a28a982afe7b tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:38:30.439378 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-9164f188-610b-4e09-8701-a28a982afe7b tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:38:30.585314 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-9164f188-610b-4e09-8701-a28a982afe7b tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b573d868454d74bdd8c7282718c085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46be7326d5204beeb8c5e499e9d4ac73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:38:30.593123 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-9164f188-610b-4e09-8701-a28a982afe7b tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79" status: 200 len: 1756 microversion: 2.1 time: 0.167210 Mar 31 18:38:30.593666 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 612/1212] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:38:30 2022] GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79 => generated 1756 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Mar 31 18:38:31.609661 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-87beee8a-7b62-4354-b276-bfe76f17cc38 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:38:31.610259 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-87beee8a-7b62-4354-b276-bfe76f17cc38 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] [instance: ec1cd9ca-0d6b-409d-a208-8b7a3040fd79] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:38:31.616801 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-87beee8a-7b62-4354-b276-bfe76f17cc38 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:38:31.617173 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-87beee8a-7b62-4354-b276-bfe76f17cc38 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:38:31.617935 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-87beee8a-7b62-4354-b276-bfe76f17cc38 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:38:31.618361 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-87beee8a-7b62-4354-b276-bfe76f17cc38 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:38:31.768218 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-87beee8a-7b62-4354-b276-bfe76f17cc38 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b573d868454d74bdd8c7282718c085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46be7326d5204beeb8c5e499e9d4ac73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:38:31.776222 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-87beee8a-7b62-4354-b276-bfe76f17cc38 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79" status: 200 len: 1756 microversion: 2.1 time: 0.170506 Mar 31 18:38:31.777052 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 601/1213] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:38:31 2022] GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79 => generated 1756 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:38:32.794487 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-ee1f071b-064b-4aa8-a28f-93833b84e6ff tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:38:32.795081 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-ee1f071b-064b-4aa8-a28f-93833b84e6ff tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] [instance: ec1cd9ca-0d6b-409d-a208-8b7a3040fd79] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:38:32.802441 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-ee1f071b-064b-4aa8-a28f-93833b84e6ff tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:38:32.803109 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-ee1f071b-064b-4aa8-a28f-93833b84e6ff tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:38:32.804671 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-ee1f071b-064b-4aa8-a28f-93833b84e6ff tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:38:32.805109 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-ee1f071b-064b-4aa8-a28f-93833b84e6ff tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:38:32.959988 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-ee1f071b-064b-4aa8-a28f-93833b84e6ff tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b573d868454d74bdd8c7282718c085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46be7326d5204beeb8c5e499e9d4ac73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:38:32.967875 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-ee1f071b-064b-4aa8-a28f-93833b84e6ff tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79" status: 200 len: 1759 microversion: 2.1 time: 0.178176 Mar 31 18:38:32.968445 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 613/1214] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:38:32 2022] GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79 => generated 1759 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:39:28.034402 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 31 18:39:28.035179 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: Thu Mar 31 18:39:28 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 31 18:39:36.300786 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-7cca981d-7677-43e8-9fbc-a05881008267 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-123221379"}} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:39:36.301404 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-7cca981d-7677-43e8-9fbc-a05881008267 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] [instance: ec1cd9ca-0d6b-409d-a208-8b7a3040fd79] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:39:36.307228 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-7cca981d-7677-43e8-9fbc-a05881008267 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:39:36.307664 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-7cca981d-7677-43e8-9fbc-a05881008267 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:39:36.308420 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-7cca981d-7677-43e8-9fbc-a05881008267 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:39:36.308843 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-7cca981d-7677-43e8-9fbc-a05881008267 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:39:36.550096 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.network.security_group_api [None req-7cca981d-7677-43e8-9fbc-a05881008267 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Removing security group 77a390dc-70c2-4ea5-9ee2-921b2ac634c8 from port 2c4f0f16-67af-42bd-8b69-094d8a6f726b Mar 31 18:39:37.000541 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-7cca981d-7677-43e8-9fbc-a05881008267 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] 10.222.0.58 "POST /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79/action" status: 202 len: 0 microversion: 2.1 time: 0.702900 Mar 31 18:39:37.000541 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 602/1215] 10.222.0.58 () {60 vars in 1277 bytes} [Thu Mar 31 18:39:36 2022] POST /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79/action => generated 0 bytes in 704 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 31 18:39:37.085353 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [req-03774efa-6615-49e7-9691-8c53f2fbb894 req-192e750e-8ce4-4360-8bf6-04e8b0d85c47 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec1cd9ca-0d6b-409d-a208-8b7a3040fd79", "tag": "2c4f0f16-67af-42bd-8b69-094d8a6f726b"}]} {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:39:37.097359 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-03774efa-6615-49e7-9691-8c53f2fbb894 req-192e750e-8ce4-4360-8bf6-04e8b0d85c47 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:39:37.097730 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [req-03774efa-6615-49e7-9691-8c53f2fbb894 req-192e750e-8ce4-4360-8bf6-04e8b0d85c47 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:39:37.109814 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.compute.server_external_events [req-03774efa-6615-49e7-9691-8c53f2fbb894 req-192e750e-8ce4-4360-8bf6-04e8b0d85c47 service nova] Creating event network-changed:2c4f0f16-67af-42bd-8b69-094d8a6f726b for instance ec1cd9ca-0d6b-409d-a208-8b7a3040fd79 on hv-cinder-maste Mar 31 18:39:37.117466 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [req-03774efa-6615-49e7-9691-8c53f2fbb894 req-192e750e-8ce4-4360-8bf6-04e8b0d85c47 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111651 Mar 31 18:39:37.119291 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 614/1216] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:39:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:39:38.487940 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-3eb8113d-8b75-4461-8c16-653d124c50c9 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:39:38.488714 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-3eb8113d-8b75-4461-8c16-653d124c50c9 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] [instance: ec1cd9ca-0d6b-409d-a208-8b7a3040fd79] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:39:38.499159 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3eb8113d-8b75-4461-8c16-653d124c50c9 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:39:38.499841 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3eb8113d-8b75-4461-8c16-653d124c50c9 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:39:38.501060 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3eb8113d-8b75-4461-8c16-653d124c50c9 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:39:38.502094 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-3eb8113d-8b75-4461-8c16-653d124c50c9 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:39:38.589511 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.objects.instance [None req-3eb8113d-8b75-4461-8c16-653d124c50c9 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lazy-loading 'services' on Instance uuid ec1cd9ca-0d6b-409d-a208-8b7a3040fd79 {{(pid=117539) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 31 18:39:38.825252 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-3eb8113d-8b75-4461-8c16-653d124c50c9 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79/os-volume_attachments/aa379bdb-8cb8-4904-8dc5-eb0978e864fe" status: 202 len: 0 microversion: 2.1 time: 0.343510 Mar 31 18:39:38.825991 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 603/1217] 10.222.0.58 () {58 vars in 1415 bytes} [Thu Mar 31 18:39:38 2022] DELETE /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79/os-volume_attachments/aa379bdb-8cb8-4904-8dc5-eb0978e864fe => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 31 18:39:38.836471 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-99857f2a-2dfd-4d05-b612-9676ac44b0a5 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:39:38.837615 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-99857f2a-2dfd-4d05-b612-9676ac44b0a5 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] [instance: ec1cd9ca-0d6b-409d-a208-8b7a3040fd79] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:39:38.847546 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-99857f2a-2dfd-4d05-b612-9676ac44b0a5 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:39:38.847546 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-99857f2a-2dfd-4d05-b612-9676ac44b0a5 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:39:38.847546 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-99857f2a-2dfd-4d05-b612-9676ac44b0a5 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:39:38.847546 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-99857f2a-2dfd-4d05-b612-9676ac44b0a5 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:39:38.878532 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-99857f2a-2dfd-4d05-b612-9676ac44b0a5 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047792 Mar 31 18:39:38.879121 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 615/1218] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Mar 31 18:39:38 2022] GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:39:39.133260 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [req-316c149d-fbc4-4c83-9495-844e005da7db req-fd8f55e3-c864-45c4-8a55-298895a4f9a4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec1cd9ca-0d6b-409d-a208-8b7a3040fd79", "tag": "2c4f0f16-67af-42bd-8b69-094d8a6f726b"}]} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:39:39.141307 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-316c149d-fbc4-4c83-9495-844e005da7db req-fd8f55e3-c864-45c4-8a55-298895a4f9a4 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:39:39.141762 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-316c149d-fbc4-4c83-9495-844e005da7db req-fd8f55e3-c864-45c4-8a55-298895a4f9a4 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:39:39.152381 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.compute.server_external_events [req-316c149d-fbc4-4c83-9495-844e005da7db req-fd8f55e3-c864-45c4-8a55-298895a4f9a4 service nova] Creating event network-changed:2c4f0f16-67af-42bd-8b69-094d8a6f726b for instance ec1cd9ca-0d6b-409d-a208-8b7a3040fd79 on hv-cinder-maste Mar 31 18:39:39.157833 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [req-316c149d-fbc4-4c83-9495-844e005da7db req-fd8f55e3-c864-45c4-8a55-298895a4f9a4 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028117 Mar 31 18:39:39.159247 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 604/1219] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:39:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:39:39.890588 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-a5a21ba1-b364-43c7-8abd-898118f1096b tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:39:39.891692 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-a5a21ba1-b364-43c7-8abd-898118f1096b tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] [instance: ec1cd9ca-0d6b-409d-a208-8b7a3040fd79] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:39:39.899036 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a5a21ba1-b364-43c7-8abd-898118f1096b tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:39:39.900185 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a5a21ba1-b364-43c7-8abd-898118f1096b tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:39:39.900402 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a5a21ba1-b364-43c7-8abd-898118f1096b tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:39:39.900870 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-a5a21ba1-b364-43c7-8abd-898118f1096b tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:39:39.930590 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-a5a21ba1-b364-43c7-8abd-898118f1096b tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044287 Mar 31 18:39:39.931100 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 616/1220] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Mar 31 18:39:39 2022] GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:39:40.944239 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-cd083f3c-cb1d-4e2e-8957-c43ccb4db972 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:39:40.945235 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-cd083f3c-cb1d-4e2e-8957-c43ccb4db972 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] [instance: ec1cd9ca-0d6b-409d-a208-8b7a3040fd79] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:39:40.951327 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-cd083f3c-cb1d-4e2e-8957-c43ccb4db972 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:39:40.951889 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-cd083f3c-cb1d-4e2e-8957-c43ccb4db972 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:39:40.952754 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-cd083f3c-cb1d-4e2e-8957-c43ccb4db972 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:39:40.953173 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-cd083f3c-cb1d-4e2e-8957-c43ccb4db972 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:39:40.981836 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-cd083f3c-cb1d-4e2e-8957-c43ccb4db972 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042679 Mar 31 18:39:40.982382 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 605/1221] 10.222.0.58 () {58 vars in 1301 bytes} [Thu Mar 31 18:39:40 2022] GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Mar 31 18:39:40.992575 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-337127b6-3cf6-4ed4-99f7-a750e9b1e35f tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:39:40.993072 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-337127b6-3cf6-4ed4-99f7-a750e9b1e35f tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] [instance: ec1cd9ca-0d6b-409d-a208-8b7a3040fd79] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:39:40.999330 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-337127b6-3cf6-4ed4-99f7-a750e9b1e35f tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:39:40.999779 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-337127b6-3cf6-4ed4-99f7-a750e9b1e35f tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:39:41.000538 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-337127b6-3cf6-4ed4-99f7-a750e9b1e35f tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:39:41.000966 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-337127b6-3cf6-4ed4-99f7-a750e9b1e35f tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:39:41.194510 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.wsgi [None req-337127b6-3cf6-4ed4-99f7-a750e9b1e35f tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] HTTP exception thrown: Instance ec1cd9ca-0d6b-409d-a208-8b7a3040fd79 is not attached to volume aa379bdb-8cb8-4904-8dc5-eb0978e864fe Mar 31 18:39:41.195072 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-337127b6-3cf6-4ed4-99f7-a750e9b1e35f tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Returning 404 to user: Instance ec1cd9ca-0d6b-409d-a208-8b7a3040fd79 is not attached to volume aa379bdb-8cb8-4904-8dc5-eb0978e864fe {{(pid=117538) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:39:41.195903 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-337127b6-3cf6-4ed4-99f7-a750e9b1e35f tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79/os-volume_attachments/aa379bdb-8cb8-4904-8dc5-eb0978e864fe" status: 404 len: 154 microversion: 2.1 time: 0.207365 Mar 31 18:39:41.196456 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 617/1222] 10.222.0.58 () {58 vars in 1415 bytes} [Thu Mar 31 18:39:40 2022] DELETE /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79/os-volume_attachments/aa379bdb-8cb8-4904-8dc5-eb0978e864fe => generated 154 bytes in 208 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 31 18:39:42.452632 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-2339b8f7-aeda-4f88-bd9b-c5b4cb7d9614 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:39:42.453129 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-2339b8f7-aeda-4f88-bd9b-c5b4cb7d9614 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] [instance: ec1cd9ca-0d6b-409d-a208-8b7a3040fd79] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:39:42.460094 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-2339b8f7-aeda-4f88-bd9b-c5b4cb7d9614 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:39:42.460535 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-2339b8f7-aeda-4f88-bd9b-c5b4cb7d9614 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:39:42.461288 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-2339b8f7-aeda-4f88-bd9b-c5b4cb7d9614 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:39:42.461716 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-2339b8f7-aeda-4f88-bd9b-c5b4cb7d9614 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:39:42.485502 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-2339b8f7-aeda-4f88-bd9b-c5b4cb7d9614 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] [instance: ec1cd9ca-0d6b-409d-a208-8b7a3040fd79] Going to try to terminate instance {{(pid=117539) delete /opt/stack/nova/nova/compute/api.py:2664}} Mar 31 18:39:42.774982 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-2339b8f7-aeda-4f88-bd9b-c5b4cb7d9614 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] 10.222.0.58 "DELETE /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79" status: 204 len: 0 microversion: 2.1 time: 0.325850 Mar 31 18:39:42.775580 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 606/1223] 10.222.0.58 () {58 vars in 1238 bytes} [Thu Mar 31 18:39:42 2022] DELETE /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Mar 31 18:39:42.784074 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-bd9d1365-c3ca-48f4-8377-082a58c57264 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:39:42.785369 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-bd9d1365-c3ca-48f4-8377-082a58c57264 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] [instance: ec1cd9ca-0d6b-409d-a208-8b7a3040fd79] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:39:42.791894 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-bd9d1365-c3ca-48f4-8377-082a58c57264 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:39:42.796319 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-bd9d1365-c3ca-48f4-8377-082a58c57264 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:39:42.796319 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-bd9d1365-c3ca-48f4-8377-082a58c57264 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:39:42.796319 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-bd9d1365-c3ca-48f4-8377-082a58c57264 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:39:42.933281 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-bd9d1365-c3ca-48f4-8377-082a58c57264 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b573d868454d74bdd8c7282718c085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46be7326d5204beeb8c5e499e9d4ac73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:39:42.940790 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-bd9d1365-c3ca-48f4-8377-082a58c57264 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79" status: 200 len: 1554 microversion: 2.1 time: 0.160674 Mar 31 18:39:42.941369 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 618/1224] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:39:42 2022] GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79 => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:39:43.959282 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-494e1754-d4ee-4910-a428-f8f3b733406b tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:39:43.959962 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-494e1754-d4ee-4910-a428-f8f3b733406b tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] [instance: ec1cd9ca-0d6b-409d-a208-8b7a3040fd79] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:39:43.966364 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-494e1754-d4ee-4910-a428-f8f3b733406b tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:39:43.966842 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-494e1754-d4ee-4910-a428-f8f3b733406b tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:39:43.967598 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-494e1754-d4ee-4910-a428-f8f3b733406b tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:39:43.968021 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-494e1754-d4ee-4910-a428-f8f3b733406b tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:39:44.105542 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.policy [None req-494e1754-d4ee-4910-a428-f8f3b733406b tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b573d868454d74bdd8c7282718c085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46be7326d5204beeb8c5e499e9d4ac73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117539) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:39:44.113869 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-494e1754-d4ee-4910-a428-f8f3b733406b tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79" status: 200 len: 1554 microversion: 2.1 time: 0.160172 Mar 31 18:39:44.114446 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 607/1225] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:39:43 2022] GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79 => generated 1554 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:39:45.131281 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-6748adf2-5ea9-4932-ab0a-e5a51234fc2d tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:39:45.131843 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-6748adf2-5ea9-4932-ab0a-e5a51234fc2d tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] [instance: ec1cd9ca-0d6b-409d-a208-8b7a3040fd79] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:39:45.138252 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6748adf2-5ea9-4932-ab0a-e5a51234fc2d tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:39:45.138728 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6748adf2-5ea9-4932-ab0a-e5a51234fc2d tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:39:45.139501 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6748adf2-5ea9-4932-ab0a-e5a51234fc2d tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:39:45.139933 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-6748adf2-5ea9-4932-ab0a-e5a51234fc2d tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:39:45.375176 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-6748adf2-5ea9-4932-ab0a-e5a51234fc2d tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b573d868454d74bdd8c7282718c085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46be7326d5204beeb8c5e499e9d4ac73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:39:45.382591 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-6748adf2-5ea9-4932-ab0a-e5a51234fc2d tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79" status: 200 len: 1554 microversion: 2.1 time: 0.255154 Mar 31 18:39:45.383135 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 619/1226] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:39:45 2022] GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79 => generated 1554 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:39:45.584416 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [req-7fb2d335-588e-41ea-8ae2-49d4b0dd5e9d req-47e513a8-ffcf-4281-900d-afb683674c30 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec1cd9ca-0d6b-409d-a208-8b7a3040fd79", "name": "network-vif-deleted", "tag": "2c4f0f16-67af-42bd-8b69-094d8a6f726b"}]} {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Mar 31 18:39:45.593042 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-7fb2d335-588e-41ea-8ae2-49d4b0dd5e9d req-47e513a8-ffcf-4281-900d-afb683674c30 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:39:45.593644 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [req-7fb2d335-588e-41ea-8ae2-49d4b0dd5e9d req-47e513a8-ffcf-4281-900d-afb683674c30 service nova] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:39:45.606404 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.compute.server_external_events [req-7fb2d335-588e-41ea-8ae2-49d4b0dd5e9d req-47e513a8-ffcf-4281-900d-afb683674c30 service nova] Creating event network-vif-deleted:2c4f0f16-67af-42bd-8b69-094d8a6f726b for instance ec1cd9ca-0d6b-409d-a208-8b7a3040fd79 on hv-cinder-maste Mar 31 18:39:45.612000 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [req-7fb2d335-588e-41ea-8ae2-49d4b0dd5e9d req-47e513a8-ffcf-4281-900d-afb683674c30 service nova] 10.222.0.58 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031251 Mar 31 18:39:45.618253 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 608/1227] 10.222.0.58 () {64 vars in 1317 bytes} [Thu Mar 31 18:39:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Mar 31 18:39:46.400142 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-0a1ca120-d4a3-4805-a35e-647c6a078865 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Calling method '>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:39:46.400860 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.compute.api [None req-0a1ca120-d4a3-4805-a35e-647c6a078865 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] [instance: ec1cd9ca-0d6b-409d-a208-8b7a3040fd79] Fetching instance by UUID {{(pid=117538) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:39:46.407467 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-0a1ca120-d4a3-4805-a35e-647c6a078865 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:39:46.410173 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-0a1ca120-d4a3-4805-a35e-647c6a078865 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:39:46.410173 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-0a1ca120-d4a3-4805-a35e-647c6a078865 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:39:46.410173 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-0a1ca120-d4a3-4805-a35e-647c6a078865 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:39:46.439979 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-0a1ca120-d4a3-4805-a35e-647c6a078865 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:39:46.440440 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG oslo_concurrency.lockutils [None req-0a1ca120-d4a3-4805-a35e-647c6a078865 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117538) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:39:46.440882 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.objects.instance [None req-0a1ca120-d4a3-4805-a35e-647c6a078865 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lazy-loading 'fault' on Instance uuid ec1cd9ca-0d6b-409d-a208-8b7a3040fd79 {{(pid=117538) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Mar 31 18:39:46.481823 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.policy [None req-0a1ca120-d4a3-4805-a35e-647c6a078865 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '80b573d868454d74bdd8c7282718c085', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '46be7326d5204beeb8c5e499e9d4ac73', 'project_domain_id': 'default', 'roles': ['reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117538) authorize /opt/stack/nova/nova/policy.py:199}} Mar 31 18:39:46.489565 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-0a1ca120-d4a3-4805-a35e-647c6a078865 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79" status: 200 len: 1349 microversion: 2.1 time: 0.093288 Mar 31 18:39:46.490322 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 620/1228] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:39:46 2022] GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79 => generated 1349 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Mar 31 18:39:47.507480 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-d977c9d4-1d78-4538-b749-a5c83fe095af tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Calling method '>' {{(pid=117539) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:39:47.508172 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.compute.api [None req-d977c9d4-1d78-4538-b749-a5c83fe095af tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] [instance: ec1cd9ca-0d6b-409d-a208-8b7a3040fd79] Fetching instance by UUID {{(pid=117539) get /opt/stack/nova/nova/compute/api.py:2918}} Mar 31 18:39:47.514904 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-d977c9d4-1d78-4538-b749-a5c83fe095af tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:39:47.515336 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-d977c9d4-1d78-4538-b749-a5c83fe095af tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:39:47.516092 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-d977c9d4-1d78-4538-b749-a5c83fe095af tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Mar 31 18:39:47.516513 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG oslo_concurrency.lockutils [None req-d977c9d4-1d78-4538-b749-a5c83fe095af tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Lock "1ceefcae-4d4b-47f0-bf59-76eb32505fbe" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117539) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Mar 31 18:39:47.530142 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.wsgi [None req-d977c9d4-1d78-4538-b749-a5c83fe095af tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] HTTP exception thrown: Instance ec1cd9ca-0d6b-409d-a208-8b7a3040fd79 could not be found. Mar 31 18:39:47.530751 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: DEBUG nova.api.openstack.wsgi [None req-d977c9d4-1d78-4538-b749-a5c83fe095af tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Returning 404 to user: Instance ec1cd9ca-0d6b-409d-a208-8b7a3040fd79 could not be found. {{(pid=117539) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:936}} Mar 31 18:39:47.531556 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO nova.api.openstack.requestlog [None req-d977c9d4-1d78-4538-b749-a5c83fe095af tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] 10.222.0.58 "GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79" status: 404 len: 111 microversion: 2.1 time: 0.028308 Mar 31 18:39:47.532086 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: [pid: 117539|app: 0|req: 609/1229] 10.222.0.58 () {58 vars in 1235 bytes} [Thu Mar 31 18:39:47 2022] GET /compute/v2.1/servers/ec1cd9ca-0d6b-409d-a208-8b7a3040fd79 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Mar 31 18:39:47.540293 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: DEBUG nova.api.openstack.wsgi [None req-b95ca1b3-fa40-4e90-883e-3bd8acc36a69 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] Calling method '.version_select at 0x7fa4d42d78b0>' {{(pid=117538) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Mar 31 18:39:47.664565 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO nova.api.openstack.requestlog [None req-b95ca1b3-fa40-4e90-883e-3bd8acc36a69 tempest-TestMinimumBasicScenario-86674644 tempest-TestMinimumBasicScenario-86674644-project] 10.222.0.58 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1436027325" status: 202 len: 0 microversion: 2.1 time: 0.128043 Mar 31 18:39:47.665148 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: [pid: 117538|app: 0|req: 621/1230] 10.222.0.58 () {58 vars in 1271 bytes} [Thu Mar 31 18:39:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-1436027325 => generated 0 bytes in 129 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Mar 31 18:40:24.014219 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 31 18:40:24.015060 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: Thu Mar 31 18:40:24 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 31 18:41:41.137668 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 31 18:41:41.138228 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: Thu Mar 31 18:41:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 31 18:42:11.956450 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 31 18:42:11.957099 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: Thu Mar 31 18:42:11 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 31 18:42:23.796329 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 31 18:42:23.796947 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: Thu Mar 31 18:42:23 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 31 18:42:29.657423 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 31 18:42:29.658085 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: Thu Mar 31 18:42:29 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 31 18:42:48.042634 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 31 18:42:48.043318 dv-cinder-master-3-iscsi devstack@n-api.service[117538]: Thu Mar 31 18:42:48 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 31 18:43:44.023127 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 31 18:43:44.023782 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: Thu Mar 31 18:43:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Mar 31 18:45:01.147228 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Mar 31 18:45:01.148028 dv-cinder-master-3-iscsi devstack@n-api.service[117539]: Thu Mar 31 18:45:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!